Streaming Live Events
You can stream production data to Fiddler as an alternative to batch publishing. Streaming offers lower latency, which is beneficial for high-velocity or near real-time models.
When to Use Streaming vs. Batch Publishing
Use streaming when low latency is a priority and you're working with individual events or small batches
Use batch publishing for large datasets or when you need to track longer-running processes with Job objects
Stream Individual Inference Events
To stream a single inference event:
Stream Small Batches of Events
For better efficiency, you can stream multiple events at once:
🚧 Note
Convert a pandas DataFrame to a list of event dictionaries using the to_dict function.
For batches larger than 5,000 events, prefer batch publishing over streaming.
Last updated
Was this helpful?