Infrastructure & Compute
Quantization
Reducing the numerical precision used by a model to make it smaller or faster.
Example
Quantization stores model values with fewer bits so the model uses less memory.
Why people use it
Knowing how “Quantization” works helps teams plan the hardware and services needed to run AI.
What you'll hear
“What does Quantization mean for the infrastructure we need?”