Skip to main content
For a complete reference of all LLM enrichments with output columns and sub-metrics, see the LLM Observability Metrics Reference.
Fiddler offers enrichments out of the box to monitor different aspects of LLM applications. Use the below table to select the right enrichment for your specific use case. This table provides high level information on the metric, the enrichment to use to measure the metric, if the metric uses LLMs, and if so, what LLM it uses. If you have a use case not covered by the below enrichments out of the box, please contact your administrator.
MetricMetric CategoryDescriptionEnrichmentLLM Used?LLM Type
FaithfulnessHallucinationThis enrichment identifies the accuracy and reliability of facts presented in AI-generated textsfaithfulnessYesOpenAI
Centor FaithfulnessHallucinationThis enrichment identifies the accuracy and reliability of facts presented in AI-generated texts. It is generated by Fiddler’s Fiddler Centor Modelsftl_response_faithfulnessYesFiddler Fiddler Centor Model
Answer RelevanceHallucinationThis enrichment measures the pertinence of AI-generated responses to their inputsanswer_relevanceYesOpenAI
ConcisenessHallucinationThis enrichment evaluates the brevity and clarity of AI-generated responsesconcisenessYesOpenAI
CoherenceHallucinationThis enrichment assesses the logical flow and clarity of AI-generated responsescoherenceYesOpenAI
Centor SafetySafetyThis enrichment generates 11 different safety metrics to measure texts upon. These metrics are: illegal, hateful, harassing, racist, sexist, violent, sexual, harmful, unethical, jailbreaking, roleplayingftl_prompt_safetyYesFiddler Fiddler Centor Model
PIISafetyThis enrichment flags the presence of sensitive information within textual datapiiNo
Regex MatchSafetyThis enrichment compares the text with a regular expression stringregex_matchNo
TopicSafetyThis enrichment classifies the text into several preset dimensions using a zero-shot classifiertopic_modelNo
Banned KeywordsSafetyThis enrichment detects the presence of banned keywords configured by the userbanned_keywordsNo
ProfanitySafetyThis enrichment flags the use of offensive or inappropriate languageprofanityNo
Language DetectionSafetyThis enrichment identifies the language of the source textlanguage_detectionNo
EvaluateText StatisticsThis enrichment provides classic text evaluation methods such as BLEU, ROUGE, and MeteorevaluateNo
SentimentText StatisticsThis enrichment provides sentiment analysis of the target textsentimentNo
TextStatText StatisticsThis enrichment provides various text statistics such as character/letter count, Flesch-Kincaid, and otherstextstatNo
Token CountText StatisticsThe Token Count enrichment is designed to count the number of tokens in a string.token_countNo
SQLValidationText ValidationEvaluates different query dialects for syntax correctness.sql_validationNo
JSONValidationText ValidationValidates JSON for correctness and optionally against a user-defined schema.json_validationNo