AI Safety & Responsible AI
Automation bias
Trusting a computer's suggestion too much, even when other evidence suggests it is wrong.
Example
A reviewer accepts an incorrect AI recommendation without inspecting the supporting record.
Why people use it
It names the habit of trusting a computer's suggestion more than the evidence deserves.
What you'll hear
“I accepted it because the system sounded certain.”
What this means for you
Make independent checking part of the workflow rather than a routine approval click.
Can you control it?
No
No direct control. This describes a wider issue, concept or result rather than something you can simply switch on or off in a tool.
Common questions
- Does a person reviewing the answer remove automation bias?
- No. A reviewer can still defer to the system.
- Can experienced people show this bias too?
- Yes. Expertise does not prevent someone from relying too heavily on a convenient automated suggestion.
- Can a confidence number make it worse?
- It can, particularly when people mistake a displayed score for a guarantee of correctness.