Security & Privacy
Abuse detection
Identifying suspicious, harmful, or policy-violating use of an AI system.
Example
Monitoring flags one account that suddenly creates thousands of suspicious prompts.
Why it matters
It helps operators notice harmful patterns that ordinary success checks may overlook.
You'll hear it
“That burst of requests looks different from normal use.”
Can you control it?
Set by the team
The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.
Common questions
- Can legitimate activity look suspicious?
- Yes. Unusual but harmless behavior can trigger a flag.
- Can attackers change behavior to avoid detection?
- Yes. The patterns used to detect abuse may need updating.
- Does identifying abuse automatically stop it?
- No. Detection needs a suitable response process to have a practical effect.