Overview
Fiddler Guardrails provides enterprise-grade protection against critical LLM risks in production environments. This solution actively moderates and mitigates harmful content in both prompts and responses, including hallucinations, toxicity, safety violations, prompt injection attacks, and jailbreaking attempts. The solution is powered by proprietary, fine-tuned, task-specific Fiddler Centor Models, specifically engineered for real-time content analysis.Key Benefits
- Industry’s Fastest Guardrails: Achieves sub-100ms latency for real-time moderation without impacting user experience
- Enterprise Scalability: Handles 5+ million daily requests with consistent performance and reliability
- Resource Efficiency: Purpose-built Centor Models deliver high accuracy with significantly lower computational requirements than general-purpose LLMs
- Enterprise Security: Deployed in the customer’s VPC or air-gapped environment with data never leaving the customer’s environment
Availability
Fiddler Guardrails is available as part of the Fiddler AI Observability and Security platform. You access Guardrails in your own Fiddler environment over the REST API (https://{fiddler_endpoint}/v3/guardrails/*) using a Fiddler API key generated from Settings → Credentials.
Fiddler Guardrails covers safety, faithfulness (hallucination), and PII/PHI detection, each powered by a purpose-built Fiddler Centor Model. See the Quick Start Guide to set up access and make your first call.
Next Steps
Explore additional documentation to get the most out of your Fiddler Guardrails experience.Fiddler Guardrails guides include:
- Quick Start Guide
- Guardrails Documentation
- Frequently Asked Questions
- Notebook Tutorials: