The best answer is D. The dataset for training the model was obtained from an unreliable source.
ISACA’s AI and ML guidance places strong emphasis on the quality, reliability, and validation of input and training data. ISACA notes that controls must validate each data source and that corrupted or poor-quality training data can lead to poor-quality outcomes. If the training dataset comes from an unreliable source, the model’s predictions may be fundamentally flawed, biased, manipulated, or unauditable from the start.
Option A. Open source programming language is not inherently a concern. The language itself does not determine whether the model is reliable or controlled.
Option B. Tested with data from the same population as the training data is a common validation step and not inherently problematic by itself.
Option C. Accuracy decreased with a different population can be a concern about generalizability, but in this question it is less fundamental than unreliable training data. If the source data itself is untrustworthy, all downstream results are suspect.
Therefore, D is the correct answer because unreliable training data creates the most serious foundational risk to the model’s validity and trustworthiness.
References (Official ISACA):
ISACA Journal, Developing Trustworthy AI: Understanding the Inputs.
ISACA Journal, Artificial Intelligence’s Impact on Auditing—Emerging Technologies.
ISACA press release, New ISACA Publications Highlight Machine Learning Technology and Compliance Risk for Auditors.
ISACA, AI Algorithm Audits: Key Control Considerations.
Submit