Skip to content

AI Foundations

Optimization

The process of changing model parameters to reduce error or improve an objective.

Example

The training process repeatedly changes weights to reduce prediction error.

Why it matters

It helps search through many possible internal settings without trying every combination by hand.

You'll hear it

“The score has stopped improving even though training is still running.”

Can you control it?

Set by the team

The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.

Common questions

Can different starting points lead to different results?
Yes. The search can follow different paths and settle on different solutions.
Does optimization find the perfect model?
No. The result depends on the examples, method and available computing time.
How is optimization different from training?
Training includes preparing and learning from examples; optimization is the part that adjusts values toward the chosen target.

AI chatbot

Still have questions?

Ask the AI chatbot about this term or another AI concept.

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice