Infrastructure & Compute
Cold start
The extra delay when a service or model must initialize before handling its first request.
Example
The first request is slow because the serverless model must start and load its weights.
Why people use it
Knowing how “Cold start” works helps teams plan the hardware and services needed to run AI.
What you'll hear
“What does Cold start mean for the infrastructure we need?”