Model Training & Adaptation
Preference data
Examples showing which of two or more model outputs are considered better.
Example
Reviewers choose the better of two summaries, creating preference data for later training.
Why people use it
Knowing how “Preference data” works helps teams adapt models deliberately and diagnose training problems.
What you'll hear
“Would Preference data improve the model for our specific use case?”