Pass the Amazon Web Services AWS Certified AI Practitioner AIF-C01 Questions and answers with CertsForce

Building and training a generative AI model from scratch provides the company with the most ownership and control over security responsibilities. In this scenario, the company is responsible for all aspects of the security of the data, the model, and the infrastructure.

Option D (Correct): " Building and training a generative AI model from scratch by using specific data that a customer owns " : This is the correct answer because it involves complete ownership of the model, data, and infrastructure, giving the company the highest level of responsibility for security.

Option A: " Using a third-party enterprise application that has embedded generative AI features " is incorrect as the company has minimal control over the security of the AI features embedded within a third-party application.

Option B: " Building an application using an existing third-party generative AI foundation model (FM) " is incorrect because security responsibilities are shared with the third-party model provider.

Option C: " Refining an existing third-party generative AI FM by fine-tuning the model with business-specific data " is incorrect as the foundation model and part of the security responsibilities are still managed by the third party.

AWS AI Practitioner References:

Generative AI Security Scoping Matrix on AWS: AWS provides a security responsibility matrix that outlines varying levels of control and responsibility depending on the approach to developing and using AI models.

The correct answer is B because Amazon CloudWatch provides monitoring capabilities that include tracking usage metrics for Amazon Comprehend endpoints, such as invocation counts. You can configure CloudWatch to collect these metrics and create custom dashboards or alarms to report when an endpoint has zero usage over a period (e.g., 15 days).

From AWS documentation:

" Amazon CloudWatch enables you to collect and track metrics for Comprehend endpoints, create alarms, and automatically react to changes in your AWS resources. "

This allows automated reporting and alerting for underused or idle endpoints.

Explanation of other options:

A. AWS Trusted Advisor focuses on general AWS resource optimization, security, and limits but does not track endpoint usage.

C. AWS CloudTrail tracks API calls but does not provide time-based monitoring or usage analysis over time.

D. AWS Config is used to track configuration changes and compliance, not endpoint usage metrics.

Referenced AWS AI/ML Documents and Study Guides:

Amazon CloudWatch Metrics for Amazon Comprehend

AWS Certified Machine Learning Specialty Guide – Monitoring and Logging Section

AWS Cloud Operations Guide – Resource Utilization Monitoring

Real-time inference is designed to provide immediate, low-latency predictions, which is necessary when the company requires near real-time latency for its ML models. This option is optimal when there is a need for fast responses, even with large input data sizes and substantial processing times.

Option A (Correct): " Real-time inference " : This is the correct answer because it supports low-latency requirements, which are essential for real-time applications where quick response times are needed.

Option B: " Serverless inference " is incorrect because it is more suited for intermittent, small-scale inference workloads, not for continuous, large-scale, low-latency needs.

Option C: " Asynchronous inference " is incorrect because it is used for workloads that do not require immediate responses.

Option D: " Batch transform " is incorrect as it is intended for offline, large-batch processing where immediate response is not necessary.

AWS AI Practitioner References:

Amazon SageMaker Inference Options: AWS documentation describes real-time inference as the best solution for applications that require immediate prediction results with low latency.

The correct answer is A because code translation tasks require a model with deep understanding of syntax, semantic meaning, and the ability to maintain functional equivalence in different programming languages. Some foundation models offered via Amazon Bedrock (like CodeWhisperer or Meta’s Code LLMs) are designed with these capabilities in mind.

From AWS documentation:

" Generative AI models used for code generation and translation must understand programming semantics and syntax to generate accurate and secure code. These models are trained to recognize language-specific patterns and preserve logic when converting between languages. "

Explanation of other options:

B. Speed and error handling are secondary to correctness and comprehension in code translation tasks.

C. Creative content generation is not relevant for deterministic tasks like source code translation.

D. Model size may affect performance or latency but is not a primary selection criterion for translation accuracy.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Model Selection Guide – Code Generation and Translation

AWS Developer Tools – CodeWhisperer Capabilities

AWS ML Specialty Study Guide – LLM Use Cases in Software Engineering

AWS documentation identifies ROUGE as a standard evaluation metric for text summarization tasks. ROUGE measures the overlap of n-grams, sequences, or word pairs between a machine-generated summary and a human-written reference summary, making it ideal for automated evaluation.

In this scenario, the company needs a metric that directly compares generated summaries with human references. ROUGE scores quantify how much of the reference content is captured by the model output, which aligns with AWS recommendations for evaluating summarization quality.

The other metrics are not appropriate. F1 score is typically used for classification tasks. Perplexity measures language model confidence but does not compare outputs to reference summaries. Fréchet Inception Distance is used for image generation tasks, not text.

AWS consistently recommends ROUGE for summarization evaluation, making it the correct choice.

Comprehensive and Detailed Explanation from AWS AI Documents:

Fine-tuning a foundation model means taking a pre-trained large model and continuing its training on domain-specific or task-specific data to specialize it for a particular use case. Fine-tuning does not retrain the FM from scratch (which would be costly and time-consuming). Instead, it improves model accuracy, relevance, and contextual adaptation for the intended application (e.g., legal, healthcare, customer support).

From AWS Docs:

“With Amazon Bedrock, you can fine-tune foundation models on your own data to specialize them for your unique use cases.”

“Fine-tuning a foundation model adapts it to a specific task by training on smaller sets of labeled data relevant to the problem domain.”

???? Reference:

AWS Documentation – Fine-tuning foundation models in Amazon Bedrock

Amazon SageMaker Ground Truth Plus provides a fully managed data labeling service where AWS manages the workforce, tools, and processes.

Data Wrangler is for data preparation and transformation.

Transcribe is for speech-to-text.

Macie is for sensitive data discovery, not labeling.

???? Reference:

AWS Documentation – SageMaker Ground Truth Plus

Ongoing pre-training when fine-tuning a foundation model (FM) improves model performance over time by continuously learning from new data.

Ongoing Pre-Training:

Involves continuously training a model with new data to adapt to changing patterns, enhance generalization, and improve performance on specific tasks.

Helps the model stay updated with the latest data trends and minimize drift over time.

Why Option B is Correct:

Performance Enhancement: Continuously updating the model with new data improves its accuracy and relevance.

Adaptability: Ensures the model adapts to new data distributions or domain-specific nuances.

Why Other Options are Incorrect:

A. Decrease model complexity: Ongoing pre-training typically enhances complexity by learning new patterns, not reducing it.

C. Decreases training time requirement: Ongoing pre-training may increase the time needed for training.

D. Optimizes inference time: Does not directly affect inference time; rather, it affects model performance.

The correct answer is D because Amazon Bedrock provides access to foundation models (FMs) from various providers for generative AI use cases, including text generation. It supports generating content in a consistent tone, voice, or writing style using prompts or few-shot examples.

From AWS documentation:

" Amazon Bedrock allows you to build and scale generative AI applications using foundation models from AI21 Labs, Anthropic, Cohere, Meta, Mistral, Stability AI, and Amazon. These models can generate text with controlled tone and style for applications like branding, content creation, and copywriting. "

Explanation of other options:

A. Amazon Comprehend is for natural language understanding, such as sentiment analysis and entity recognition, not generation.

B. Amazon Personalize is for building recommendation systems, not content generation.

C. Amazon Rekognition is for image and video analysis, not text generation.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Bedrock Developer Guide – Generative AI Use Cases

AWS Certified Machine Learning Specialty Guide – Content Generation with FMs

Amazon SageMaker Ground Truth lets you create data labeling jobs and can integrate with Amazon Mechanical Turk (a distributed human workforce) to label large unlabeled datasets.

A (batch inference) applies models to already-trained data, not labeling.

B (PyTorch Distributed) is for distributed training, not labeling.

D (OCR) applies only to text extraction from images, not transactions.

E is incorrect; Ground Truth is the service for labeling, not " AI labeling job. "

???? Reference:

AWS Documentation – SageMaker Ground Truth