Misinformation (7fa229ac-8dc2-5258-bdc0-e114a08219d2)
AI models may generate hallucinations, producing incorrect, misleading, or fabricated information. These errors can undermine trust, propagate misinformation, and lead to unsafe decision-making.
- Misinformation Amplification: False information generated by AI could be exploited in disinformation campaigns or lead to incorrect medical, financial, or legal advice.
- Reinforcement of Biases: AI hallucinations could disproportionately affect marginalized groups, reinforcing biases in generated content.
- Sycophancy Risk: Some models are prone to agree with users’ views even when incorrect, reinforcing user confirmation bias.
- Hallucination Types: In hallucinations the outputs can contradict or misalign with the prompt, introduce unrelated or fabricated elements or include factually incorrect statements.
Threat-modeling question: Could AI-generated hallucinations lead to misinformation or decision-making risks?
| Cluster A | Galaxy A | Cluster B | Galaxy B | Level |
|---|---|---|---|---|
| Publish Hallucinated Entities (53c52153-8a3f-4952-8e20-e9ab7ca899a7) | MITRE ATLAS Attack Pattern | Misinformation (7fa229ac-8dc2-5258-bdc0-e114a08219d2) | PLOT4ai | 1 |