Pass the Amazon Web Services AWS Certified AI Practitioner AIF-C01 Questions and answers with CertsForce

The least operational overhead comes from automated tools that can scan and evaluate LLM outputs for toxicity. AWS and SageMaker JumpStart support integrations with automatic evaluation tools and APIs (such as Amazon Comprehend or third-party toxicity classifiers).

B is correct: Automated evaluation provides quick, scalable, and repeatable analysis, requiring minimal human intervention.

A and C require manual effort, increasing operational overhead.

D (RLHF) is resource-intensive and not designed for rapid, automated model comparison.

" Automated evaluation can quickly assess generated text for specific attributes like toxicity, sentiment, or compliance using pre-trained classifiers, reducing human involvement and operational complexity. "

(Reference: AWS SageMaker JumpStart Evaluation, AWS AI Practitioner Guide)

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon SageMaker Model Cards provide a structured way to document:

Approved training datasets

Intended use cases

Ethical considerations and limitations

Compliance with internal policies and governance standards

Model Cards are a Responsible AI governance tool, enabling transparency and accountability throughout the model lifecycle.

Why the other options are incorrect:

Catalog (A) organizes ML assets but does not enforce ethical or policy documentation.

Clarify (B) detects bias and explainability issues but does not govern approved data usage.

Model Registry (C) manages model versions and approvals but does not document ethical intent.

AWS AI document references:

Amazon SageMaker Model Cards Documentation

AWS Responsible AI Practices

AI Governance on AWS

The F1 score is the harmonic mean of precision and recall, making it a balanced metric for evaluating model performance when there is an imbalance between false positives and false negatives. Speed, cost, and energy efficiency are unrelated to the F1 score. References: AWS Foundation Models Guide.

Comprehensive and Detailed Explanation From Exact AWS AI documents:

Amazon Bedrock provides access to multiple foundation models from different providers and enables customers to evaluate, compare, and select the most appropriate model for their generative AI use cases.

Amazon Bedrock:

Offers a choice of foundation models

Supports model evaluation and customization

Abstracts infrastructure management

Why the other options are incorrect:

Amazon Personalize (A) is a recommendation service.

Amazon Q Developer (C) is a coding assistant.

Amazon Rekognition (D) is an image and video analysis service.

AWS AI document references:

Amazon Bedrock Overview

Choosing Foundation Models on AWS

Generative AI Model Selection Guidance

The company wants to improve the accuracy of a generative AI application using a foundation model (FM) on Amazon Bedrock in the most cost-effective way. Prompt engineering involves optimizing the input prompts to guide the FM to produce more accurate responses without modifying the model itself. This approach is cost-effective because it does not require additional computational resources or training, unlike fine-tuning or retraining.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

" Prompt engineering is a cost-effective technique to improve the performance of foundation models. By crafting precise and context-rich prompts, users can guide the model to generate more accurate and relevant responses without the need for fine-tuning or retraining. "

(Source: AWS Bedrock User Guide, Prompt Engineering for Foundation Models)

Detailed Explanation:

Option A: Fine-tune the FM.Fine-tuning involves retraining the FM on a custom dataset, which requirescomputational resources, time, and cost (e.g., for Amazon Bedrock fine-tuning jobs). It is not the most cost-effective solution.

Option B: Retrain the FM.Retraining an FM from scratch is highly resource-intensive and expensive, as it requires large datasets and significant compute power. This is not cost-effective.

Option C: Train a new FM.Training a new FM is the most expensive option, as it involves building a model from the ground up, requiring extensive data, compute resources, and expertise. This is not cost-effective.

Option D: Use prompt engineering.This is the correct answer. Prompt engineering adjusts the input prompts to improve the FM’s responses without incurring additional compute costs, making it the most cost-effective solution for improving accuracy on Amazon Bedrock.

Amazon SageMaker ' s DeepAR is a supervised learning algorithm designed for forecasting scalar (one-dimensional) time series data. Time series data consists of sequences of data points indexed in time order, typically with consistent intervals between them. In the context of a retail store aiming to predict product demand, relevant time series data might include historical sales figures, inventory levels, or related metrics recorded over regular time intervals (e.g., daily or weekly). By training the DeepAR model on this historical time series data, the store can generate forecasts for future product demand. This capability is particularly useful for inventory management, staffing, and supply chain optimization. Other data types, such as text, image, or binary data, are not suitable for time series forecasting tasks and would not be appropriate inputs for the DeepAR algorithm.

Accuracy is the most appropriate metric to measure the performance of an image classification model. It indicates the percentage of correctly classified images out of the total number of images. In the context of classifying plant diseases from images, accuracy will help the company determine how well the model is performing by showing how many images were correctly classified.

Option B (Correct): " Accuracy " : This is the correct answer because accuracy measures the proportion of correct predictions made by the model, which is suitable for evaluating the performance of a classification model.

Option A: " R-squared score " is incorrect as it is used for regression analysis, not classification tasks.

Option C: " Root mean squared error (RMSE) " is incorrect because it is also used for regression tasks to measure prediction errors, not for classification accuracy.

Option D: " Learning rate " is incorrect as it is a hyperparameter for training, not a performance metric.

AWS AI Practitioner References:

Evaluating Machine Learning Models on AWS: AWS documentation emphasizes the use of appropriate metrics, like accuracy, for classification tasks.

A prompt template defines how the model is structured and guided (system prompts, roles, guardrails).

An attack that reveals or leaks this prompt template is known as a prompt extraction attack.

The other options (persona switching, exploiting friendliness, ignoring prompts) describe adversarial techniques but do not directly expose the internal configured behavior.

???? Reference:

AWS Responsible AI – Prompt Injection & Extraction Attacks

The correct answer is D – Purchase Provisioned Throughput on Amazon Bedrock, which provides guaranteed and predictable model capacity for workloads with consistent or steady request volume. According to AWS Bedrock documentation, Provisioned Throughput is specifically designed for production applications that require reliable, consistent inference performance at a controlled cost. It allows customers to reserve a fixed number of model inference units (MIUs), ensuring low latency and cost savings compared to on-demand pricing when traffic is steady. On-demand throughput (option B) is ideal for unpredictable or sporadic usage, but it becomes more expensive for stable traffic patterns because it charges per token with no discount for steady volume. Hosting the model on EC2 (option A) or Lambda (option C) increases operational overhead, requires model containerization, scaling management, and may not support LLM-level GPU performance efficiently. Bedrock Provisioned Throughput eliminates infrastructure management and provides the most cost-effective solution for stable, predictable workloads.

Referenced AWS Documentation:

Amazon Bedrock Developer Guide – Provisioned Throughput

AWS ML Specialty Study Guide – Cost Optimization for Generative AI

RAG combines large pre-trained models with retrieval mechanisms to fetch relevant context from a knowledge base. This approach is cost-effective as it eliminates the need for frequent model retraining while ensuring responses are contextually accurate and up to date. References: AWS RAG Techniques.