Skip to content

Model Serving & Economics

Fallback model

A backup model used when the preferred model is unavailable or unsuitable.

Example

If the primary provider fails, the application sends the request to a fallback model.

Why it matters

It helps keep a service usable when the usual model cannot handle a request.

You'll hear it

“The backup is answering, but its replies need the same checks.”

Can you control it?

Sometimes

Sometimes. Some products or workflows let you influence a fallback model, while others keep it fixed or manage it automatically. Check the settings and documentation for the tool you are using.

Common questions

Will the backup behave exactly like the main model?
Usually not. It may follow instructions differently or have different limits.
Can switching change where my information is sent?
Yes, if the backup uses another provider or location. Include it in your data-handling review.
Should users be told that the backup is running?
When it changes what they can rely on, a clear notice helps them make an informed choice.

AI chatbot

Still have questions?

Ask the AI chatbot about this term or another AI concept.

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice