Model Serving & Economics
Small language model
SLM
A relatively compact language model optimized for lower cost, speed, or local deployment.
Example
A small language model runs locally on a phone for private, low-latency tasks.
Why it matters
It can make simpler AI features practical when equipment, battery life or budgets are limited.
You'll hear it
“The smaller model handles these short requests well enough.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Can a small model answer difficult questions?
- Sometimes, especially within a narrow subject. Test the particular questions rather than judging by size alone.
- Does small automatically mean private?
- No. Privacy depends on where it runs and how information is handled, not just model size.
- Can it work with company documents?
- Yes, if the product supplies suitable documents. Access to those documents is a separate feature.