Skip to main content

​
What This Is

A third-party AI gateway is an inline proxy your application already routes LLM traffic through. Fiddler plugs in at that layer, so you get observability, guardrail enforcement, or both — with no application code changes. Fiddler documents three: Kong AI Gateway, AgentGateway, and LiteLLM.
Not to be confused with the Fiddler LLM Gateway. The Fiddler LLM Gateway manages Fiddler’s own provider credentials for evaluators and enrichments — Fiddler calling out to model providers. A third-party AI gateway proxies your traffic to your models. This page is about the latter.

​
Two Capabilities, Independent

Each integration offers up to two capabilities, and either can be deployed without the other:

​
Which Gateways

Kong AI Gateway

Tracing on Kong 3.13+. Guardrails need Kong 3.14+ with an AI Gateway Enterprise license. Live today. · Guardrails

AgentGateway

Apache 2.0. Tracing on v1.1.0+. Guardrails need v1.4.0+ and Fiddler 26.17+. · Guardrails

LiteLLM

Open source. SDK or proxy. Live today. · Guardrails

​
Capability Comparison

Each page is authoritative for its own exact behavior and version floors; this table is a starting point, not a substitute.

​
Which Checks Run

Across all three gateways, Fiddler’s guardrail adapters run two checks: PII and secrets. Faithfulness — offered elsewhere in Fiddler Protect — is not available on the gateway path. See each guardrails page for per-check thresholds, actions, and what can be tuned.

​
Choosing a Path

Use the gateway you already run. If you only need visibility, start with tracing; add guardrails when you need enforcement. Kong blocks on a detection; AgentGateway and LiteLLM can redact in place. If you need to redact streamed responses, review the streaming limits on the owning guardrails page first.

​
What Every Integration Guarantees

  • No application code changes — you point at the gateway you already run.
  • The guardrail adapter is stateless — Fiddler evaluates text in-request and returns a decision; no prompt, response, or detection result is retained (the only durable artifact is content-free operational counters).
  • Each page is the source of truth for its gateway’s exact version floors, wire contract, and configuration surface.

​
Next Steps