PROMPTS & APIs • 107 / 397
Understand how applications send instructions to models and handle production API behavior.
Streaming
Streaming returns generated output incrementally instead of waiting for the entire response.
Think of it like
Think of Streaming like a restaurant or service desk: the request must reach the right endpoint in the right format and the response must be handled safely.
Real life
Web applications use concepts such as Streaming to communicate with external services.
SRE lens
Users see the first token sooner even if total generation takes several seconds.
Remember thisStreaming returns generated output incrementally instead of waiting for the entire response.