◆ Definition
Transformer
The neural network architecture behind modern AI, built on the attention mechanism. Introduced in 2017; nearly every frontier language model since is a descendant.
Learn more in these free lessons
- The Transformer Architecture · AI Deep Dive
- Beyond Vanilla Transformers: MoE and Friends · AI Deep Dive
- The AI Pipeline and Learning Paradigms · AI Essentials
- Why This Moment Is Different · AI Deep Dive
- Multimodal Architecture · AI Deep Dive
- What is AI? Definition and the Revolution · AI Essentials