When to Use Streaming vs. Batch Publishing
- Use
Model.publish_stream()when low latency is a priority and you’re working with individual events or small batches - Use
Model.publish_batch()for large datasets or when you need to track longer-running processes with Job objects
Stream Individual Inference Events
To stream a single inference event:Stream Small Batches of Events
For better efficiency, you can stream multiple events at once:🚧 Note Convert a pandas DataFrame to a list of event dictionaries using the to_dict function.
Model.publish_batch() over streaming.