Generative AI & LLMs
Transformer
A neural-network architecture that processes relationships between pieces of information using attention.
Example
A translation model processes words in relation to one another instead of strictly one at a time.
Why it matters
It helps systems connect information that may be far apart in a passage or other material.
You'll hear it
“The design can connect details from different parts of the document.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Is a transformer a complete chatbot?
- No. A chatbot also needs surrounding software, instructions and ways for people to interact.
- Can transformers work with pictures?
- Yes. Related designs can process pieces of images and other material, not just words.
- Does the design guarantee a long document is understood correctly?
- No. Important details can still be missed or connected incorrectly.