PROMPTS & APIs • 90 / 397
Understand how applications send instructions to models and handle production API behavior.
Request
A request is the data and metadata an application sends to a service.
Think of it like
Think of Request like a restaurant or service desk: the request must reach the right endpoint in the right format and the response must be handled safely.
Real life
Web applications use concepts such as Request to communicate with external services.
SRE lens
An LLM request may contain model name, messages, tools and generation limits.
Remember thisA request is the data and metadata an application sends to a service.