Skip to content

Prompting

Context rot

AI doing worse as the information it must consider becomes longer, messier or less useful.

Example

An assistant overlooks a key instruction buried in a long conversation.

Why people use it

It explains why more conversation history can sometimes make an answer worse.

What you'll hear

“The important instruction got lost in a long thread.”

What this means for you

Keep important instructions clear and remove irrelevant or stale background information.

Can you control it?

No

No direct control. This describes a wider issue, concept or result rather than something you can simply switch on or off in a tool.

Common questions

Does a larger amount of text it can accept prevent this loss of accuracy?
No. Capacity to accept text does not guarantee effective use of all of it.
Can outdated information contribute?
Yes. Old plans or conflicting details can distract from the current task.
Does restarting a conversation always fix it?
No. Starting fresh can also lose information needed to do the task well.

Related terms

Still have questions?

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice