Pass the Amazon Web Services AWS Certified AI Practitioner AIF-C01 Questions and answers with CertsForce

Fine-tuning involves training an already pre-trained FM on a smaller, labeled dataset for task specialization.

Data selection is about curating training data.

Pre-training is the initial training phase on massive datasets.

Evaluation happens after training, not during.

???? Reference:

AWS Documentation – Fine-tuning in Amazon Bedrock

Amazon Bedrock Guardrails provides contextual grounding checks to determine whether foundation model responses are supported by reference information and relevant to user queries.

According to AWS documentation, contextual grounding checks require three components:

1. Grounding source: Reference information used to establish factual context.

2. User query: The question or request submitted by the user.

3. Model response: The generated content evaluated against the reference source and query.

These checks evaluate two important dimensions: grounding, which determines whether claims are supported by source information, and relevance, which determines whether responses address the user ' s question.

Option B includes API credentials, which are not a contextual grounding component. Option C describes development interfaces. Option D includes confidence scores and thresholds, which support evaluation but cannot replace the required source and response.

Therefore, option A is correct.

AWS Reference: https://docs.aws.amazon.com/bedrock/latest/userguide/guardrails-contextual-grounding-check.html

Amazon OpenSearch Service (formerly Amazon Elasticsearch Service) has introduced capabilities to support vector search, which allows companies to build vector database applications. This is particularly useful in machine learning, where vector representations (embeddings) of data are often used to capture semantic meaning.

Scalable index management and nearest neighbor search capability are the core features enabling vector database functionalities in OpenSearch. The service allows users to index high-dimensional vectors and perform efficient nearest neighbor searches, which are crucial for tasks such as recommendation systems, anomaly detection, and semantic search.

Here is why option C is the correct answer:

Scalable Index Management: OpenSearch Service supports scalable indexing of vector data. This means you can index a large volume of high-dimensional vectors and manage these indexes in a cost-effective and performance-optimized way. The service leverages underlying AWS infrastructure to ensure that indexing scales seamlessly with data size.

Nearest Neighbor Search Capability: OpenSearch Service ' s nearest neighbor search capability allows for fast and efficient searches over vector data. This is essential for applications like product recommendation engines, where the system needs to quickly find the most similar items based on a user ' s query or behavior.

AWS AI Practitioner References:

According to AWS documentation, OpenSearch Service ' s support for nearest neighbor search using vector embeddings is a key feature for companies building machine learning applications that require similarity search.

The service uses Approximate Nearest Neighbors (ANN) algorithms to speed up searches over large datasets, ensuring high performance even with large-scale vector data.

The other options do not directly relate to building vector database applications:

A. Integration with Amazon S3 for object storage is about storing data objects, not vector-based searching or indexing.

B. Support for geospatial indexing and queries is related to location-based data, not vectors used in machine learning.

D. Ability to perform real-time analysis on streaming data relates to analyzing incoming data streams, which is different from the vector search capabilities.

The correct answer is B because Amazon SageMaker JumpStart provides pre-built solutions, including training workflows for popular open-source LLMs such as Falcon, LLaMA, and others. It allows practitioners to quickly launch fine-tuning jobs using predefined templates, minimizing operational setup and code complexity.

From AWS documentation:

" Amazon SageMaker JumpStart enables you to fine-tune and deploy foundation models with minimal setup. It provides easy-to-use interfaces and pre-built configurations for training, which significantly reduces the operational overhead required to train models. "

Explanation of other options:

A. PartyRock is designed for prototyping generative AI apps but does not support model training or fine-tuning.

C. Writing a custom script for SageMaker training is flexible but involves more operational effort, including handling infrastructure configuration.

D. Training on EC2 via a Jupyter notebook is fully manual and operationally intensive, including dependency setup, data handling, and resource scaling.

Referenced AWS AI/ML Documents and Study Guides:

Amazon SageMaker JumpStart Developer Guide – Fine-tuning Foundation Models

AWS Certified Machine Learning Specialty Guide – Model Customization and JumpStart

AWS PrivateLink enables private connectivity between VPCs and AWS services without exposing traffic to the public internet. This feature is critical for meeting regulatory compliance standards that require isolation from public internet traffic.

Option A (Correct): " AWS PrivateLink " : This is the correct answer because it allows secure access to Amazon Bedrock and other AWS services from a VPC without internet access, ensuring compliance with regulatory standards.

Option B: " Amazon Macie " is incorrect because it is a security service for data classification and protection, not for managing private network traffic.

Option C: " Amazon CloudFront " is incorrect because it is a content delivery network service and does not provide private network connectivity.

Option D: " Internet gateway " is incorrect as it enables internet access, which violates the VPC ' s no-internet-traffic policy.

AWS AI Practitioner References:

AWS PrivateLink Documentation: AWS highlights PrivateLink as a solution for connecting VPCs to AWS services privately, which is essential for organizations with strict regulatory requirements.

The verified answer is A. Present the model Shapley values. AWS documentation states that SageMaker Clarify provides feature attributions based on Shapley values. These values can determine the contribution each feature made to model predictions and can be provided for individual predictions or at a global level for the model as a whole. That is exactly what stakeholders need when they ask for transparency and explainability: they need to understand which features influenced the model’s decisions and how strongly those features contributed.

AWS also explains that SageMaker Clarify helps explain how ML models make predictions and that transparency is critical for consumers and regulators. Clarify’s explainability uses a model-agnostic feature attribution approach and includes a scalable implementation of SHAP. These explanations answer practical stakeholder questions such as why the model made a prediction, how it makes predictions, and which features have the largest influence on model behavior.

Option B is incorrect because accuracy measures predictive correctness, not explainability. A model can be highly accurate while still being opaque. Accuracy alone does not show why a specific prediction was made.

Option C is incorrect because a confusion matrix summarizes classification performance by showing true positives, false positives, true negatives, and false negatives. It is useful for evaluation, but it does not explain individual feature influence or model reasoning.

Option D is incorrect because a secure inference endpoint protects access to the deployed model. Security is important, but it does not provide transparency or explainability.

Therefore, presenting Shapley values is the correct solution because it directly explains feature contributions to model predictions.

In the context of AI, " hallucination " refers to the phenomenon where a model generates outputs that are plausible-sounding but are not grounded in reality or the training data. This problemoften occurs with large language models (LLMs) when they create information that sounds correct but is actually incorrect or fabricated.

Option B (Correct): " Hallucination " : This is the correct answer because the problem described involves generating content that sounds factual but is incorrect, which is characteristic of hallucination in generative AI models.

Option A: " Data leakage " is incorrect as it involves the model accidentally learning from data it shouldn ' t have access to, which does not match the problem of generating incorrect content.

Option C: " Overfitting " is incorrect because overfitting refers to a model that has learned the training data too well, including noise, and performs poorly on new data.

Option D: " Underfitting " is incorrect because underfitting occurs when a model is too simple to capture the underlying patterns in the data, which is not the issue here.

AWS AI Practitioner References:

Large Language Models on AWS: AWS discusses the challenge of hallucination in large language models and emphasizes techniques to mitigate it, such as using guardrails and fine-tuning.

Providing examples of text passages with corresponding positive or negative labels in the prompt followed by the new text passage to be classified is the correct prompt engineering strategy for using a large language model (LLM) on Amazon Bedrock for sentiment analysis.

Example-Driven Prompts:

This strategy, known as few-shot learning, involves giving the model examples of input-output pairs (e.g., text passages with their sentiment labels) to help it understand the task context.

It allows the model to learn from these examples and apply the learned pattern to classify new text passages correctly.

Why Option A is Correct:

Guides the Model: Providing labeled examples teaches the model how to perform sentiment analysis effectively, increasing accuracy.

Contextual Relevance: Aligns the model ' s responses to the specific task of classifying sentiment.

Why Other Options are Incorrect:

B. Detailed explanation of sentiment analysis: Unnecessary for the model ' s operation; it requires examples, not explanations.

C. New text passage without context: Provides no guidance or learning context for the model.

D. Unrelated task examples: Would confuse the model and lead to inaccurate results.

Context engineering involves organizing the information, instructions, and examples provided to a foundation model so that it generates more relevant and useful responses.

The company needs meeting summaries that consistently identify decisions, commitments, assigned responsibilities, and follow-up actions.

Providing reviewed and approved action-item examples through structured prompts helps demonstrate the expected output format and information priorities.

This approach uses few-shot prompting, which improves model performance by supplying representative examples of desired behavior.

A larger context window provides greater input capacity but does not necessarily improve identification of important decisions.

Fine-tuning could improve specialized behavior but introduces additional training requirements and implementation overhead.

Amazon Bedrock Guardrails primarily supports safety, security, and content policies rather than ensuring complete action-item extraction.

Therefore, structured prompts with approved examples directly address the identified summarization-quality problem.