Model Serving & Economics
Model router
A system that sends each request to the most suitable model based on cost, quality, or task.
Example
A router sends simple questions to a cheap model and complex ones to a stronger model.
Why it matters
It helps balance spending and answer quality across different kinds of requests.
You'll hear it
“Keep private documents away from models we haven't approved.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Does every request go to the same provider?
- Not necessarily. The service may choose among several, depending on its settings.
- Can a router work without AI?
- Yes. Fixed rules can choose a model based on request size, availability or other clear conditions.
- Why might replies change between otherwise similar requests?
- The service may select different models. Checking the request record can help explain the difference.