Model Serving & Economics
Model serving
Making a trained model available to applications so they can send inputs and receive outputs.
Example
A serving system keeps a trained model available and turns requests into predictions.
Why people use it
Teams use “Model serving” when they need to balance model quality, reliability, speed, and cost.
What you'll hear
“How does Model serving affect latency, quality, or cost at scale?”