TRANSFORMERS & LLMs • 37 / 397
Follow text from characters to tokens, attention, transformers and generation.
Sequence
A sequence is an ordered series of elements such as tokens in text.
Think of it like
Think of Sequence as part of a very fast reader that repeatedly decides what information matters and what should come next.
Real life
Autocomplete, translation and chat assistants depend on concepts such as Sequence.
SRE lens
Logs, commands and natural-language prompts are sequences the model processes in order.
Remember thisA sequence is an ordered series of elements such as tokens in text.