Model Serving & Economics
Routing model
A model that decides which model, tool, or path should handle a request.
Example
A lightweight model examines the request and chooses the best specialist model.
Why it matters
It helps a service choose a suitable next step when requests vary widely.
You'll hear it
“That billing question was sent to the wrong specialist.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Does it write the final answer?
- Not necessarily. Its job may end after choosing where the request should go.
- What if a request fits two specialties?
- The surrounding system needs a way to choose, combine help or ask the person to clarify.
- Can wrong routing look like a bad answer?
- Yes. A capable specialist can still struggle when given a request outside its area.