TRANSFORMERS & LLMs • 66 / 397
Follow text from characters to tokens, attention, transformers and generation.
Context
Context is the information available to the model for the current generation, including instructions, messages, retrieved text and tool results.
Think of it like
Think of Context as part of a very fast reader that repeatedly decides what information matters and what should come next.
Real life
Autocomplete, translation and chat assistants depend on concepts such as Context.
SRE lens
Incident logs and runbook snippets must fit into usable context.
Remember thisContext is the information available to the model for the current generation, including instructions, messages, retrieved text and tool results.