Generative AI & LLMs
Sampling
The process of choosing the next generated token from the model's probability distribution.
Example
A writing tool samples among likely next tokens instead of always choosing the single most likely one.
Why people use it
Understanding “Sampling” helps teams choose and configure generative systems more effectively.
What you'll hear
“How does Sampling affect the answer the model gives the user?”