Generative AI & LLMs
Attention
A mechanism that lets a model weigh which parts of the input matter most for the current prediction.
Example
While translating a pronoun, the model gives extra importance to the earlier noun it refers to.
Why it matters
It helps a system focus its calculations on information useful for the current task.
You'll hear it
“It gave too much importance to the heading and missed the note.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Does attention mean the AI is consciously concentrating?
- No. The word describes calculations, rather than evidence of awareness or intention.
- Can it focus on the wrong clue?
- Yes. What receives more influence is not necessarily what a person would consider most important.
- Does an attention pattern fully explain an answer?
- Not by itself. Other parts of the system also influence what it produces.