Generative AI & LLMs
Pretraining
The large-scale initial training stage that teaches a foundation model broad patterns.
Example
A language model first learns broad language patterns from a very large text collection.
Why people use it
Knowing how “Pretraining” works helps teams choose and configure generative systems more effectively.
What you'll hear
“How does Pretraining affect the answer the model gives the user?”