Generative AI & LLMs
Self-attention
Attention where the model compares elements within the same sequence to understand their relationships.
Example
A sentence compares each word with the other words in that same sentence.
Why people use it
Understanding “Self-attention” helps teams choose and configure generative systems more effectively.
What you'll hear
“How does Self-attention affect the answer the model gives the user?”