Pass the ISTQB ISTQB AI Testing CT-AI Questions and answers with CertsForce

The ISTQB CT-AI syllabus explains supervised learning under Section1.6 – Machine Learning Approaches. It definesclassificationas predictingcategorical labels, whereasregressionpredictscontinuous numerical values. OptionB—deciding whether an object is a bicycle or a motorcycle—fits the definition of classification precisely because the model chooses between discrete categories. The syllabus also uses similar examples to illustrate classification tasks, reinforcing that this is the correct interpretation .

Option A is incorrect because image recognition of a dog is aclassificationtask, not regression. Option C is incorrect because predicting a 10% price rise involves forecasting anumerical value, which is aregressionproblem. Option D is incorrect because classification can involveany number of classes, not only two. Multiclass classification is explicitly mentioned in the syllabus.

Therefore, OptionBis the only answer aligned with the syllabus’ definitions.

The syllabus clearly explains the structure of a deep neural network (DNN):

"A deep neural network comprises three types of layers. The input layer receives inputs... Between the input and output layers are hidden layers made up of artificial neurons, which are also known as nodes."

(Reference: ISTQB CT-AI Syllabus v1.0, Section 6.1, page 45 of 99)

The ISTQB CT-AI syllabus definesoverfittingin Section3.2 – ML Model Evaluationas a condition where an ML model learns the training data too precisely—including noise and irrelevant detail—resulting in poor performance on unseen data. Overfitting is characterized byhigh accuracy on training data but low accuracy on validation or real-world data. OptionAperfectly matches this definition: a model trained only on one university’s student data generalizes poorly to students from other universities. This is a textbook example of overfitting because the model has essentially memorized patterns unique to a narrow dataset, instead of learning generalizable relationships applicable across environments .

Option B instead describessample biasor inadequate training diversity, not overfitting. Option C involvestransfer learningor model extension, unrelated to overfitting. Option D indicatesinsufficient training data qualityor lack of meaningful features, but not overfitting. Only Option A reflects the syllabus definition directly: overly specialized training leading to reduced predictive performance on new data.

Thus,Ais the correct and syllabus-aligned example of overfitting.

Section2.2 – Data Preparationand4.1 – Challenges in Testing AI-Based Systemsdescribe difficulties in obtaining and managing large, representative datasets. AI-based systems requirerealistic, diverse, and representativedata reflecting real-world variations. The syllabus emphasizes that assembling such datasets is time-consuming, resource-intensive, and often constrained by availability, privacy, or domain complexity. Option B directly corresponds to these documented challenges.

Option A is incorrect: using the same implementation risksdefect masking, not preventing it; the syllabus warns against this practice. Option C is incorrect because real-world data naturally evolves, and the syllabus notes thatdriftis normal; expecting stable input data contradicts operational reality. Option D is incorrect: although data privacy is important, the syllabus does not claim that artificially generated data always requires legal approval, nor that sanitization/encryption is mandatory for synthetic data.

Thus,Option Baccurately reflects syllabus-defined difficulties in producing representative test data.

Section4.2 – Test Coverage Criteria for AI Modelsof the ISTQB CT-AI syllabus describes neural network–specific coverage methods. Among the techniques,threshold coverageis explicitly noted asadaptable, meaning testers may choose different thresholds to determine whether neuron activation is considered “covered.” This flexibility makes threshold coverage adjustable to the model architecture, problem domain, and required test thoroughness.

Options A and B (Sign–Sign and Sign–Change coverage) are more rigid structural criteria and are not described as adaptable within the syllabus. They focus on sign patterns of neuron activations and do not allow altering thresholds. Option D, neuron coverage, measures the proportion of neurons activated at least once. Although simple, it is not defined as an adaptable criterion. Its limitations are documented: it provides shallow insight and too easily achieves high coverage.

Onlythreshold coverageallows testers to adjust activation thresholds for more refined coverage measurement, makingOption Cthe correct choice.

 Factors Affecting ML Functional Performance:The data pipeline, quality of the labeling, and biased data are all factors that significantly affect the performance of machine learning models. The number of classes, while relevant for the model structure, is not a direct factor affecting the performance metrics such as accuracy or bias.

 Reference:ISTQB_CT-AI_Syllabus_v1.0, Sections on Data Quality and its Effect on the ML Model and ML Functional Performance Metrics​​​​.