Skip to content

Model Serving & Economics

Output tokens

Tokens generated by a model in its response.

Example

Every word generated in the answer contributes to output-token usage.

Why people use it

Knowing how “Output tokens” works helps teams balance model quality, reliability, speed, and cost.

What you'll hear

“How does Output tokens affect latency, quality, or cost at scale?”

Related terms