Token counter
Paste text to see it split into tokens by the o200k_base tokenizer, count characters and words per token, and see what share of common context window sizes it uses.
Runs in your browser. Your input is not sent anywhere.
Paste text to see it split into tokens by the o200k_base tokenizer, count characters and words per token, and see what share of common context window sizes it uses.
Runs in your browser. Your input is not sent anywhere.