Concept · Building with AI

Token

Also called: tokens, token limit, token cost, token usage

In AI, a small chunk of text, roughly a word or a piece of a word, that an LLM reads and writes. AI services measure usage, limits and price in tokens.

For example: A long document you paste into an AI tool is split into many tokens. A longer document means more tokens and a higher cost.

Connects to 18

• LLM Concept
• Context window Concept
• Inference Concept
• Tokenizer Concept
• Next-token prediction Concept
• Usage-based pricing Concept
• Rate limit Concept
• Reasoning model Concept
• Model provider Concept
• Input tokens Concept
• Output tokens Concept
• Cache tokens Concept
• Effort Concept
• Attention Concept
• Attention relationship Concept
• Primary source Concept
• Sampling Concept
• MicroGPT Tool