Tagged "tokens"
What is a context window in an LLM?
The context window is the maximum number of tokens a language model can consider at once. Learn what fills it, what happens when it overflows, and how to budget it.
LLM foundationsBeginner3 minWhat is a token in an LLM?
A token is the unit of text a language model reads and writes. Learn how tokenizers split text, why token counts differ by language, and why it matters for cost.
LLM foundationsBeginner4 min