Evaluation & Quality
Data drift
A change in the kinds or patterns of information an AI receives.
Example
AI taught with daytime photos begins receiving mostly nighttime pictures.
Why people use it
It warns teams that incoming information differs from what the AI previously encountered.
What you'll hear
“We're getting a very different mix of photos now.”
What this means for you
Check whether changed information has actually made results worse.
Can you control it?
No
No direct control. This describes a wider issue, concept or result rather than something you can simply switch on or off in a tool.
Common questions
- Does data drift always reduce accuracy?
- No. Some changes matter more to the task than others.
- Can a seasonal change cause it?
- Yes. A holiday period or weather change can alter the kinds of information arriving.
- Is drift always a sign of bad information?
- No. The new information may be accurate but describe circumstances the AI has seen less often.