Skip to content

Generative AI & LLMs

Greedy decoding

AI choosing the highest-scoring next piece each time it builds a reply.

Example

A writing AI always selects its highest-scoring next piece of text.

Why people use it

It provides a straightforward way to choose the next piece of generated writing.

What you'll hear

“Choose the most likely next piece each time.”

What this means for you

Judge the complete answer rather than the certainty of each local choice.

Can you control it?

Developer-only

The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.

Common questions

Can this method repeat a phrase?
Yes. Familiar wording can be selected repeatedly when it keeps receiving the highest score.
Does choosing the best next piece guarantee the best whole answer?
No. A locally attractive choice can lead to a less useful continuation.
Does it encourage variety?
Usually less than methods that deliberately allow different possible next choices.

Related terms

Still have questions?

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice