◆ Definition
Distillation
Training a smaller, cheaper model to imitate a larger one's outputs. The main route by which frontier-level capability trickles down into fast, affordable, and on-device models.
Learn more in these free lessons
- Scaling Laws · AI Deep Dive
- Why This Moment Is Different · AI Deep Dive
- The Economics of Intelligence · AI Deep Dive
- Reasoning Models · AI Deep Dive
- The Road Ahead · AI Deep Dive