Guardrails FAQ
Find answers to common questions about Fiddler Free Guardrails, including setup, implementation, and general information for protecting your LLM applications.
Last updated
Was this helpful?
Find answers to common questions about Fiddler Free Guardrails, including setup, implementation, and general information for protecting your LLM applications.
Last updated
Was this helpful?
Q: Why am I getting much higher latencies than advertised?
A: The lower latencies are only available on paid plans when a request is made to a dedicated Fiddler deployment within the same network boundaries.
Latency spikes can also occur due to temporary usage surges, even though we provision for peak capacity. If you’re consistently experiencing higher latencies, please contact us on the #fiddler-guardrails-support channel.
Q: What does this error code mean? How do I fix it?
A: Please visit our for detailed information about error codes and their solutions.
Q: What's included in the Free Guardrails?
A: The Free Guardrails include:
200 requests per day limit
70 requests per hour limit
2 requests per second
Integration options with NVIDIA NeMo Guardrails and Langchain
Q: Can I get a higher rate limit?
Q: Will there be an in-app upgrade option in the future?
A: We recognize the importance of a seamless upgrade experience and are actively exploring ways to improve this in future versions. Your feedback helps shape our roadmap.
Q: What is the Fiddler Trust Service?
Q: How does Fiddler Guardrails use the Fiddler Trust Service?
A: At <100ms latency, Fiddler Guardrails is the fastest in the industry. It leverages the scoring of the Fiddler Trust Models to evaluate prompts and responses and moderate harmful outputs for hallucination, toxicity, and jailbreaks. Simply specify your desired metric thresholds and let Fiddler Guardrails handle the enforcement.
Q: What languages are supported?
A: Fiddler Guardrails currently only supports English. Based on user feedback, we're evaluating support for additional languages.
Q: How can I stay updated on service improvements?
A: Stay informed about regular updates to Fiddler Guardrails by:
Q: Where can I share feedback or request features?
A: We welcome your input! Please reach out to our team on Slack in the #fiddler-guardrails-support channel. Your feedback helps us prioritize improvements.
Q: Is Fiddler Guardrails an experimental or beta product?
A: No, Fiddler Guardrails is a fully supported service from Fiddler AI Observability and Security platform. While the Free Guardrails is a public preview with some limitations, the feature-complete experience is available to platform subscribers.
Q: Are you hiring?
A: There's currently no in-app rate limit upgrade option. However, we offer paid plans with increased capacity, additional features, and enterprise-level support. to discuss your requirements.
A: Integral to the Fiddler AI Observability and Security platform, the includes a series of proprietary, fine-tuned Fiddler Trust Models that enable high quality LLM monitoring, scoring in live environments with the fastest guardrails in the industry. For added security, the Fiddler Trust Service can be deployed in VPC or air-gapped environments, ensuring enterprises maintain strict data control and safeguard LLM applications.
Following our
Subscribing to our
Joining the
A: We are! Please look at our for open positions.