Evaluation & Quality
Rubric
A defined set of criteria used to score the quality of an output.
Example
Reviewers use written criteria describing what earns each score.
Why it matters
It helps people judge the same qualities rather than rely on personal impressions.
You'll hear it
“What makes this answer a three instead of a four?”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Can a rubric miss an important quality?
- Yes. An answer may score well while failing a requirement that was never included.
- Should reviewers be allowed to explain a difficult score?
- Yes. Notes can reveal uncertainty or cases the criteria do not handle well.
- Can changing the rubric invalidate earlier comparisons?
- It can. Scores made under different rules may no longer be directly comparable.