Model Distillation

AI Cost Management

A technique where a smaller student model learns to mimic a larger teacher model. Distillation reduces model size and inference cost while preserving most of the teacher model's performance.

← Back to glossary