Skip to main content

Rate Limits

Guardrail endpoints on a platform deployment are not subject to a fixed request-rate limit. Throughput is governed by the resources provisioned for your Fiddler deployment; contact your Fiddler representative for sizing guidance.

Understanding Centor Model Scores

Fiddler Centor Models return scores in the range of 0 to 1. These scores represent the model’s confidence that the input belongs to the target class (e.g., toxicity, hallucination).
  • Higher scores (closer to 1): Higher confidence that the input belongs to the target class
  • Lower scores (closer to 0): Lower confidence that the input belongs to the target class
Threshold Selection You must select a threshold value between 0 and 1 to convert these scores into binary decisions. This creates a tradeoff:
  • Lower thresholds: Catch more true positives but include more false positives
  • Higher thresholds: Reduce false positives, but might miss some true positives
Our quickstart examples include default thresholds that work well for many applications, but you should adjust these based on your specific requirements and risk tolerance. Adjusting Your Thresholds To find the optimal threshold for your use case:
  1. Start with the default threshold
  2. Monitor both missed detections and false alarms
  3. Adjust gradually based on which type of error is more problematic for your application

Safety Model

The safety guardrail accepts a large but fixed maximum input length. Inputs that exceed the limit return HTTP 413 — contact your Fiddler representative for the limit that applies to your environment.
This Fiddler Centor Model evaluates prompt safety across 11 dimensions:
  • Jailbreaking
  • Illegal content
  • Hateful content
  • Harassment
  • Racism
  • Sexism
  • Violence
  • Sexual content
  • Harmful content
  • Unethical content
  • Roleplaying
The model requires a single string input and outputs 11 distinct scores (0-1 range). For detailed information, see our official documentation. How to Use Thresholding Users can apply thresholds on individual safety dimensions (e.g., harmful, violent, racist) or evaluate all of them collectively. This flexibility allows you to tailor how strictly you filter content based on your unique requirements. Safety Model OpenAPI Spec

Centor Model for Faithfulness

The faithfulness guardrail accepts large context and response inputs, each up to a fixed maximum length. Inputs that exceed a limit return HTTP 413 — contact your Fiddler representative for the limits that apply to your environment.
This is the Centor Model for Faithfulness (ftl_response_faithfulness) — a proprietary Fiddler Centor Model for real-time guardrail use cases. For the LLM-as-a-Judge RAG Faithfulness evaluator used in Agentic Monitoring and Experiments, see the RAG Health Diagnostics guide.
This Fiddler Centor Model detects hallucinations by evaluating the accuracy and reliability of facts presented in AI-generated text responses in retrieval-augmented generation (RAG) contexts. The model requires two inputs:
  1. Response: the text generated by your generative application
  2. Context Documents: the reference text that the application response must remain faithful to
The output is a single score (float) representing the factual consistency between the response and the provided context. How to Use Thresholding Our quick start examples use a default threshold that works well in various applications. You may wish to set this higher or lower to allow you to tailor how strictly you filter content based on your unique requirements. Faithfulness Model OpenAPI Spec

Centor Model for PII/PHI (Sensitive Information Detection)

The PII/PHI guardrail accepts a large but fixed maximum input length. Inputs that exceed the limit return HTTP 413 — contact your Fiddler representative for the limit that applies to your environment.
This Fiddler Centor Model detects and identifies sensitive information including personally identifiable information (PII), protected health information (PHI), and custom-defined entities in text data. The model supports three detection modes:
  1. PII Detection: 35+ entity types including personal, financial, and government identifiers
  2. PHI Detection: 7 healthcare-specific entity types for HIPAA compliance
  3. Custom Entity Detection: Organization-specific sensitive data patterns
The model requires a single string input and outputs an array of detected entities with confidence scores, labels, and text positions. Key Features
  • High Performance: 0.1 confidence threshold with top-1024 entity filtering
  • Comprehensive Coverage: Supports 35+ PII and 7 PHI entity types
  • Custom Entities: Define organization-specific sensitive patterns
  • Detailed Output: Returns entity text, type, confidence score, and character positions
Supported PII Entity Types (35+)
  • Personal Identifiers: person, date_of_birth
  • Contact Information: email, email_address, phone_number, mobile_phone_number, landline_phone_number, address, postal_code
  • Financial Data: credit_card_number, credit_card_expiration_date, cvv, cvc, bank_account_number, iban
  • Government IDs: social_security_number, passport_number, drivers_license_number, tax_identification_number, cpf, cnpj, national_health_insurance_number
  • Digital Identifiers: ip_address, digital_signature
Supported PHI Entity Types (7)
  • Medical Information: medication, medical_condition, medical_record_number
  • Insurance Data: health_insurance_number, health_plan_id
  • Healthcare Identifiers: birth_certificate_number, device_serial_number
How to Use Thresholding The Centor Model for PII/PHI uses a default confidence threshold of 0.1, which works well for most applications. Entities with scores above this threshold are considered valid detections. You can adjust this threshold based on your specific requirements:
  • Lower thresholds (< 0.1): Catch more potential sensitive data but may include more false positives
  • Higher thresholds (> 0.1): Reduce false positives but might miss some valid sensitive information
Centor Model for PII/PHI OpenAPI Spec

Fiddler Guardrails Error Codes