Advanced Concepts
Inference-time scaling
Improving performance by giving a model more computation, samples, or search during inference.
Example
A service improves difficult-answer quality by allocating more computation during inference.
Why people use it
Teams use “Inference-time scaling” when they need to discuss emerging capabilities without confusing speculation with evidence.
What you'll hear
“How important is Inference-time scaling to the way this system behaves?”