Skip to main content
Evaluator to detect secrets and credentials in text using Fiddler Centor Models. The FTLSecretDetection evaluator scans text for API keys, tokens, and credentials, covering ~42 known credential formats plus detection of unknown secrets. It is deterministic and low-latency. Key Features:
  • Known-format detection: ~42 known credential formats across LLM providers, cloud platforms, source control, messaging, and developer tools
  • Unknown secret detection: Catches unknown or custom secrets that don’t match a known format (labeled Possible Secret)
  • Fast: Sub-millisecond latency — no inference overhead
Use Cases:
  • Secret leakage detection: Identify credentials in LLM prompts or responses
  • Compliance auditing: Scan text datasets for inadvertently captured credentials
  • Data sanitization: Locate and redact secrets in datasets before training or fine-tuning
Scoring Logic: Unlike probability-based evaluators, FTLSecretDetection returns one Score per detected secret:
  • No secrets detected: Returns an empty list
  • Secrets detected: Returns one Score per detection, with name set to the secret type label and value set to 1.0
To retrieve character-level positions for redaction, use the REST API directly — see Secret Detection tutorial.

​
Parameters

  • text (str) – The text to scan for secrets and credentials.
  • score_name_prefix (str | None)
  • score_fn_kwargs_mapping (ScoreFnKwargsMappingType | None)

​
Returns

A list of Score objects, one per detected secret:
  • name: The secret type label (e.g., "Anthropic API Key", "AWS Access Key ID")
  • evaluator_name: "FTLSecretDetection"
  • value: 1.0 for each detection (binary — present or absent)

​
Raises

ValueError – If the text is empty or None.

​
Example

FTLSecretDetection uses a lightweight, deterministic detection engine rather than an ML model. Known credential formats are detected reliably, though random-looking non-secret strings may occasionally be flagged as Possible Secret.

​
name = ‘ftl_secret_detection’

​
score()

Scan a text string for secrets and credentials.

​
Parameters

​
str
required
The text to scan for secrets and credentials.

​
Returns

A list of Score objects, one per detected secret. Empty list if no secrets found.