Skip to content

Commit f8ddb78

Browse files
tillwfrtrieu
andauthored
[MLOBS] Update language mismatch evaluation (#29258)
* [MLOBS] Update language mismatch evaluation * Update content/en/llm_observability/terms/_index.md Co-authored-by: Rosa Trieu <107086888+rtrieu@users.noreply.github.com> --------- Co-authored-by: Rosa Trieu <107086888+rtrieu@users.noreply.github.com>
1 parent 842fa1f commit f8ddb78

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

content/en/llm_observability/terms/_index.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -187,6 +187,8 @@ This check identifies instances where the LLM fails to deliver an appropriate re
187187

188188
This check identifies instances where the LLM generates responses in a different language or dialect than the one used by the user, which can lead to confusion or miscommunication. This check ensures that the LLM's responses are clear, relevant, and appropriate for the user's linguistic preferences and needs.
189189

190+
Language mismatch is only supported for natural language prompts. Input and output pairs mainly consisting of structured data such as JSON, code snippets, or special characters are not flagged as a language mismatch.
191+
190192
{{< img src="llm_observability/evaluations/language_mismatch_1.png" alt="A Language Mismatch evaluation detected by an open source model in LLM Observability" style="width:100%;" >}}
191193

192194
| Evaluation Stage | Evaluation Method | Evaluation Definition |

0 commit comments

Comments
 (0)