set_llm_context - Fiddler Documentation

Fiddler Python Client SDK

Fiddler Evals SDK

Fiddler OTel SDK

Fiddler LangGraph SDK

Fiddler LangChain SDK

Fiddler Google ADK SDK

Fiddler Strands Agent SDK

Fiddler OTel JS SDK

Fiddler LangGraph JS SDK

Fiddler LangChain JS SDK

Set or clear additional context information for LLM interactions. The LLM context allows you to provide additional background information or available options that can be tracked alongside model invocations. This context will be added to telemetry spans as ‘gen_ai.llm.context’ and can be used for debugging or analysis in Fiddler’s platform. The context persists until explicitly changed by calling this function again with a new value, or cleared by passing None. Clearing is useful in multi-step agent workflows where context set after a RAG step should not leak into later non-RAG LLM calls. Works automatically in both synchronous and asynchronous contexts.

Parameters

Model

required

The Model instance to attach context to

str | None

default:"None"

Context string providing additional information about available options, constraints, or background for the LLM interaction. Pass None to clear any previously set context.

Example

from strands.models.openai import OpenAIModel
from fiddler_strandsagents import set_llm_context

model = OpenAIModel(api_key="...", model_id="gpt-4")
set_llm_context(
    model,
    'Available hotels: Hilton, Marriott, Hyatt...'
)

# Now when the model is invoked, the context will be
# included in the telemetry span
agent = Agent(model=model, system_prompt="You are a travel assistant")
response = agent("Which hotel should I book?")

# Clear context before non-RAG steps
set_llm_context(model, None)

get_llm_context

get_span_attributes

⌘I

​Parameters

​Example

Parameters

Example