Evaluation & Quality
Pass rate
The percentage of evaluation cases that meet a defined success threshold.
Example
Eighty-six of 100 required checks succeed, producing an 86% pass rate.
Why it matters
It helps summarize whether a system meets a defined set of requirements.
You'll hear it
“What had to happen for a case to count as a pass?”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Can changing the pass rule change the rate?
- Yes. A looser rule can raise the percentage without improving the underlying behavior.
- Does a pass mean every part of the response was perfect?
- Not necessarily. The rule may check only selected requirements.
- Can the rate hide one repeatedly failing requirement?
- Yes. Strong results on other checks can overshadow a persistent weakness.