ISTQB CT-AI ISTQB Certified Tester AI Testing Exam Exam Practice Test
ISTQB Certified Tester AI Testing Exam Questions and Answers
Which ONE of the following options describes a scenario of A/B testing the LEAST?
SELECT ONE OPTION
The training of an ML model… What type of bias is LEAST important to look for when testing the model?
Choose ONE option (1 out of 4)
Which ONE of the following types of coverage SHOULD be used if test cases need to cause each neuron to achieve both positive and negative activation values?
SELECT ONE OPTION
Which of the following statements about explainable AI is correct?
Choose ONE option (1 out of 4)
Which of the following options is an example of the concept of overfitting?
Choose ONE option (1 out of 4)
Which of the following decisions is BEST as a test approach for the described situation?
Choose ONE option (1 out of 4)
Which option gives the correct values for accuracy and precision from the confusion matrix?
Choose ONE option (1 out of 4)
Which ONE of the following options is the MOST APPROPRIATE stage of the ML workflow to set model and algorithm hyperparameters?
SELECT ONE OPTION
Which ONE of the following approaches to labelling requires the least time and effort?
SELECT ONE OPTION
Which of the following is a technique used in machine learning?
A beer company is trying to understand how much recognition its logo has in the market. It plans to do that by monitoring images on various social media platforms using a pre-trained neural network for logo detection. This particular model has been trained by looking for words, as well as matching colors on social media images. The company logo has a big word across the middle with a bold blue and magenta border.
Which associated risk is most likely to occur when using this pre-trained model?
A neural network has been designed and created to assist day-traders improve efficiency when buying and selling commodities in a rapidly changing market. Suppose the test team executes a test on the neural network where each neuron is examined. For this network, the shortest path indicates a "buy" and it will only occur when the one-day predicted value of the commodity is greater than the spot price by 0.75%. The neurons are stimulated by entering commodity prices and testers verify that they activate only when the future value exceeds the spot price by at least 0.75%.
Which of the following statements BEST explains the type of coverage being tested on the neural network?
A system is to be developed to detect lung cancer using X-ray images.
Which statement BEST describes the difference between a conventional system and an AI system with supervised machine learning?
Choose ONE option (1 out of 4)
Consider a machine learning model where the model is attempting to predict if a patient is at risk for stroke. The model collects information on each patient regarding their blood pressure, red blood cell count, smoking status, history of heart disease, cholesterol level, and demographics. Then, using a decision tree the model predicts whether or not the associated patient is likely to have a stroke in the near future. Once the model is created using a training dataset, it is used to predict a stroke in 80 additional patients. The table below shows a confusion matrix on whether or not the model made a correct or incorrect prediction.

The testers have calculated what they believe to be an appropriate functional performance metric for the model. They calculated a value of 0.6667.
Which metric did the testers calculate?
Which ONE of the following characteristics is the least likely to cause safety related issues for an Al system?
SELECT ONE OPTION
Which ONE of the following options does NOT describe an Al technology related characteristic which differentiates Al test environments from other test environments?
SELECT ONE OPTION
Written requirements are given in text documents, which ONE of the following options is the BEST way to generate test cases from these requirements?
SELECT ONE OPTION
Which ONE of the following options represents a technology MOST TYPICALLY used to implement Al?
SELECT ONE OPTION
Consider an AI-system in which the complex internal structure has been generated by another software system. Why would the tester choose to do black-box testing on this particular system?
Data used for an object detection ML system was found to have been labelled incorrectly in many cases.
Which ONE of the following options is most likely the reason for this problem?
SELECT ONE OPTION
Which statement regarding the use of training, validation, and test data sets is correct?
Choose ONE option (1 out of 4)
Which ONE of the following statements is a CORRECT adversarial example in the context of machine learning systems that are working on image classifiers.
SELECT ONE OPTION
A transportation company operates three types of delivery vehicles in its fleet. The vehicles operate at different speeds (slow, medium, and fast). The transportation company is attempting to optimize scheduling and has created an AI-based program to plan routes for its vehicles using records from the medium-speed vehicle traveling to selected destinations. The test team uses this data in metamorphic testing to test the accuracy of the estimated travel times created by the AI route planner with the actual routes and times.
Which of the following describes the next phase of metamorphic testing?
You have access to the training data that was used to train an AI-based system. You can review this information and use it as a guideline when creating your tests. What type of characteristic is this?
Which of the following technologies for implementing AI is considered to be a reasoning technique?
Choose ONE option (1 out of 4)
A startup company has implemented a new facial recognition system for a banking application for mobile devices. The application is intended to learn at run-time on the device to determine if the user should be granted access. It also sends feedback over the Internet to the application developers. The application deployment resulted in continuous restarts of the mobile devices.
Which of the following is the most likely cause of the failure?
Which statement regarding data preparation in the ML workflow is correct?
Choose ONE option (1 out of 4)
Which of the following is THE LEAST appropriate tests to be performed for testing a feature related to autonomy?
SELECT ONE OPTION
Which ONE of the following models BEST describes a way to model defect prediction by looking at the history of bugs in modules by using code quality metrics of modules of historical versions as input?
SELECT ONE OPTION
An image classification system is being trained for classifying faces of humans. The distribution of the data is 70% ethnicity A and 30% for ethnicities B, C and D. Based ONLY on the above information, which of the following options BEST describes the situation of this image classification system?
SELECT ONE OPTION
Which challenge to testing self-learning systems puts you at risk of a data attack?
Choose ONE option (1 out of 4)
Which ONE of the following options describes the LEAST LIKELY usage of Al for detection of GUI changes due to changes in test objects?
SELECT ONE OPTION
A car insurance company is using a new AI service to reward defensive driving behavior among its policyholders. The driving behavior is recorded in a rating number (score).
The AI service determines this score from the following input values:
Reference speed v_max in km/h
Average speed v_mean in km/h
Average acceleration a_pos in m/s²
Average braking deceleration a_neg in m/s²
The more defensive the driving behavior is (slow driving, low acceleration, low braking deceleration), the higher is the score.
Three initial test cases (Test 1 to Test 3) are used for testing the AI service. In addition, new test cases A–D are proposed.

Which of the new tests is NOT a follow-up test case for metamorphic testing?
Choose ONE option! (1 out of 4)
Which statement describes factors related to test data that make testing AI-based systems difficult?
Choose ONE option (1 out of 4)
Max. Score: 2
Al-enabled medical devices are used nowadays for automating certain parts of the medical diagnostic processes. Since these are life-critical process the relevant authorities are considenng bringing about suitable certifications for these Al enabled medical devices. This certification may involve several facets of Al testing (I - V).
I.Autonomy
II.Maintainability
III.Safety
IV.Transparency
V.Side Effects
Which ONE of the following options contains the three MOST required aspects to be satisfied for the above scenario of certification of Al enabled medical devices?
SELECT ONE OPTION
Which ONE of the following options BEST DESCRIBES clustering?
SELECT ONE OPTION