Tagged "context window"
What is a context window in an LLM?
The context window is the maximum number of tokens a language model can consider at once. Learn what fills it, what happens when it overflows, and how to budget it.
LLM foundationsBeginner3 minWhat is a token in an LLM?
A token is the unit of text a language model reads and writes. Learn how tokenizers split text, why token counts differ by language, and why it matters for cost.
LLM foundationsBeginner4 minWhy long context windows still miss things
A million-token context window does not mean a model uses every token well. Learn about the lost-in-the-middle effect, attention cost, and how to test it yourself.
LLM foundationsIntermediate3 min