Generative AI & LLMs
Beam search
A writing method that keeps several possible continuations in consideration as it builds a reply.
Example
A translation tool considers several possible word sequences before choosing a sentence.
Why people use it
It explores several possible word sequences instead of committing to just one immediately.
What you'll hear
“Keep a few possible translations open.”
What this means for you
Compare the actual translations instead of assuming more searching always helps.
Can you control it?
Developer-only
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Can it favor ordinary wording over unusual ideas?
- Yes. Keeping the highest-scoring paths can favor familiar phrases, depending on what the AI has learned.
- Does it examine every possible sentence?
- No. It keeps a limited number of candidates rather than searching all possible wording.
- Can keeping more candidates slow things down?
- Yes. Comparing additional possibilities usually needs more computation and can increase the wait.