Generative AI & LLMs
Context window
The maximum amount of information a model can consider at one time.
Example
A long contract exceeds the model's context window, so its earliest pages must be summarized.
Why it matters
It lets a system work with more background material during a single task.
You'll hear it
“The earlier instructions no longer fit with the documents we added.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Does a larger context window guarantee better answers?
- No. Accepting all the text does not guarantee that the system will use every important detail correctly.
- What uses space in the context window?
- Instructions, earlier messages, documents, tool results and the reply itself can use the available space.
- What happens when the context is too long?
- The service may reject the request, shorten material or leave out earlier details, depending on its design.