Introduction

Complete API reference for fiddler-evals

Version: 0.3.0

Overview

Complete API reference documentation for the fiddler-evals package.

Components

Connection

Connection management and initialization

• Connection

• init

Entities

Core entity classes for interacting with the platform

• Application

• Dataset

• Experiment

• ExperimentItemStatus

• ExperimentStatus

• Project

Evaluators

Built-in and custom evaluators for LLM assessment

• AnswerRelevance

• Evaluator

• Coherence

• Conciseness

• EvalFn

• FTLPromptSafety

• FTLResponseFaithfulness

• RegexMatch

• RegexSearch

• Sentiment

• TopicClassification

• Toxicity

Pydantic Models

Pydantic data models and validation schemas

• DatasetItem

• NewDatasetItem

• Score

• ScoreStatus

Runner

Evaluation execution and orchestration

• evaluate