Skip to content

Model Serving & Economics

Cost per request

The average expense incurred each time an application calls an AI model or service.

Example

A team divides its monthly model bill by completed requests to estimate cost per request.

Why it matters

It helps teams decide whether an AI feature is affordable at expected levels of use.

You'll hear it

“How much does one successfully handled customer request really cost?”

Can you control it?

Set by the team

The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.

Common questions

Why can an average hide expensive cases?
A few large or difficult requests may cost much more than the typical one.
Does one button click always mean one model request?
No. An application may contact the model several times to finish one user task.
Should outside services be included?
For a full task estimate, include related charges such as searches, storage and document processing.

AI chatbot

Still have questions?

Ask the AI chatbot about this term or another AI concept.

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice