◆ Definition
Token
Unit of input or output processed by an AI model. For text, typically 3-4 characters of English. Images are tokenized as patches, video as frames, audio as discrete sound units. Pricing, throughput, and context limits are all measured in tokens.
Learn more in these free lessons
- Tokens and Context: The Units It Thinks In · AI for School Students
- LLM Mechanisms · AI Essentials
- Scaling Laws · AI Deep Dive
- The Economics of Intelligence · AI Deep Dive
- The Transformer Architecture · AI Deep Dive
- Beyond Vanilla Transformers: MoE and Friends · AI Deep Dive