Agentic Research

Distillation

Distillation lets a smaller student model learn from a larger teacher, usually to shrink size or cost while keeping ability.

When you will meet it

Why small models stay cheap and usable; read it with quantization to understand local-path economics.

Related terms

Next