Isaca ISACA Advanced in AI Audit (AAIA) AAIA Question # 13 Topic 2 Discussion
AAIA Exam Topic 2 Question 13 Discussion:
Question #: 13
Topic #: 2
An IS auditor is auditing an AI system that predicts inventory needs. The system recently failed to predict a stock outage for a key product. Which of the following audit tests would BEST validate the system's accuracy?
The best way to validate the accuracy of a predictive AI system is to use historical testing with past sales data (option D). According to the AAIA™ Study Guide, “historical (or back-testing) is essential for evaluating how well a model would have performed using actual data from previous periods, directly reflecting its predictive validity.” This method reveals any gaps or biases in the model by comparing predictions to known outcomes.
Unit testing, load testing, and sensitivity analysis are useful for technical verification and robustness but do not provide direct evidence of prediction accuracy in real-world scenarios.
[Reference:ISACA Advanced in AI Audit™ (AAIA™) Study Guide, Section: "AI Model Validation Techniques", ]
Contribute your Thoughts:
Chosen Answer:
This is a voting comment (?). You can switch to a simple comment. It is better to Upvote an existing comment if you don't have anything to add.
Submit