Security Testing (7dc672f6-16af-5276-8266-6f5d0b43106d)
AI systems can be targeted in unique ways, such as adversarial inputs, poisoning attacks, or reverse-engineering of model outputs. These threats could compromise the system's confidentiality, integrity, and availability, leading to reputational damage or harm to users. Testing for these issues may require specialized expertise, tools, and time, which could affect project timelines.
Threat-modeling question: Could we be deploying the AI system without testing for adversarial robustness and systemic vulnerabilities?