# Fiddler Evals SDK

- [Introduction](https://docs.fiddler.ai/api/fiddler-evals-sdk/evals.md): Complete API reference for fiddler-evals
- [Connection](https://docs.fiddler.ai/api/fiddler-evals-sdk/connection.md)
- [Connection](https://docs.fiddler.ai/api/fiddler-evals-sdk/connection/connection.md): Manages authenticated connections to the Fiddler platform.
- [init](https://docs.fiddler.ai/api/fiddler-evals-sdk/connection/init.md): Initialize the Fiddler client with connection parameters and global configuration.
- [Entities](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities.md)
- [Application](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities/application.md): Represents a GenAI Application container for organizing GenAI application resources.
- [Dataset](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities/dataset.md): Represents a Dataset container for organizing evaluation test cases.
- [Experiment](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities/experiment.md): Represents an Experiment for tracking evaluation runs and results.
- [ExperimentItemStatus](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities/experiment-item-status.md): ExperimentItemStatus
- [ExperimentStatus](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities/experiment-status.md): ExperimentStatus
- [Project](https://docs.fiddler.ai/api/fiddler-evals-sdk/entities/project.md): Represents a project container for organizing GenAI Apps and resources.
- [Evaluators](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators.md)
- [AnswerRelevance](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/answer-relevance.md): Evaluator to assess how well an answer addresses a given question with optional context.
- [Coherence](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/coherence.md): Evaluator to assess the coherence and logical flow of a response.
- [Conciseness](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/conciseness.md): Evaluator to assess how concise and to-the-point an answer is.
- [ContextRelevance](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/context-relevance.md): Evaluator to assess how relevant retrieved documents are to a user query.
- [CustomJudge](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/custom-judge.md): Create a fully customizable LLM-as-a-Judge evaluator with your own prompt and output schema.
- [CustomJudgeSpec](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/custom-judge-spec.md): Reusable prompt specification for CustomJudge evaluators.
- [EvalFn](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/eval-fn.md): Evaluator that wraps a user-provided function for dynamic evaluation.
- [Evaluator](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/evaluator.md): Abstract base class for creating custom evaluators in Fiddler Evals.
- [FTLPromptSafety](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/ftl-prompt-safety.md): Evaluator to assess prompt safety using Fiddler Centor Models.
- [FTLResponseFaithfulness](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/ftl-response-faithfulness.md): Evaluator to assess response faithfulness using Fiddler Centor Models.
- [InputFieldSpec](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/input-field-spec.md): Metadata for a template variable (input field).
- [Message](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/message.md): A single message in a prompt template.
- [OutputField](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/output-field.md): Schema for a single output field in the evaluation response.
- [OutputFieldTransform](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/output-field-transform.md): Defines how to transform an LLM output field into a final output field.
- [RAGFaithfulness](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/rag-faithfulness.md): Evaluator to assess if an LLM response is faithful to the provided context.
- [RegexMatch](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/regex-match.md): Regex match attempts to match the regex pattern only at the beginning
- [RegexSearch](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/regex-search.md): Regex search scans the entire string from beginning to end, looking for the
- [Sentiment](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/sentiment.md): Evaluator to assess text sentiment using Fiddler's sentiment analysis model.
- [TopicClassification](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluators/topic-classification.md): Evaluator to classify text topics using Fiddler's zero-shot topic classification model.
- [Pydantic Models](https://docs.fiddler.ai/api/fiddler-evals-sdk/pydantic-models.md)
- [DatasetItem](https://docs.fiddler.ai/api/fiddler-evals-sdk/pydantic-models/dataset-item.md): Dataset item from Fiddler API
- [NewDatasetItem](https://docs.fiddler.ai/api/fiddler-evals-sdk/pydantic-models/new-dataset-item.md): Model to create a new dataset
- [Score](https://docs.fiddler.ai/api/fiddler-evals-sdk/pydantic-models/score.md): A single output of an evaluator.
- [ScoreStatus](https://docs.fiddler.ai/api/fiddler-evals-sdk/pydantic-models/score-status.md): The status of a score.
- [evaluate](https://docs.fiddler.ai/api/fiddler-evals-sdk/evaluate.md): Evaluate a dataset using a task function and a list of evaluators.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.fiddler.ai/api/fiddler-evals-sdk.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
