TRANSFORMERS & LLMs • 58 / 397
Follow text from characters to tokens, attention, transformers and generation.
Language Model
A language model estimates patterns and probabilities over language sequences.
Think of it like
Think of Language Model as part of a very fast reader that repeatedly decides what information matters and what should come next.
Real life
Autocomplete, translation and chat assistants depend on concepts such as Language Model.
SRE lens
An LLM is a very large language model used by AI applications.
Remember thisA language model estimates patterns and probabilities over language sequences.