◆ Definition
Inference
Running a trained model to get an answer — as opposed to training, which builds the model. Training happens rarely and costs a lot once; inference happens billions of times a day and now dominates total AI spend.
Learn more in these free lessons
- Inference & Latency Optimisation · AI Deep Dive
- The Economics of Intelligence · AI Deep Dive
- Scaling Laws · AI Deep Dive
- The Compute Stack · AI Deep Dive
- LLM Landscape · AI Essentials
- On-Device & Open-Weight AI · AI Essentials