Model Serving & Economics
Input tokens
Tokens sent into a model as instructions, context, or user content.
Example
The full document and instructions count toward the request's input tokens.
Why people use it
Teams use “Input tokens” when they need to balance model quality, reliability, speed, and cost.
What you'll hear
“How does Input tokens affect latency, quality, or cost at scale?”