Summer Certification Special Limited Time 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: force70

Microsoft Designing and Building Integrated AI Agent Solutions in Copilot Studio AB-620 Question # 5 Topic 1 Discussion

Microsoft Designing and Building Integrated AI Agent Solutions in Copilot Studio AB-620 Question # 5 Topic 1 Discussion

AB-620 Exam Topic 1 Question 5 Discussion:
Question #: 5
Topic #: 1

You create a test set in Copilot Studio to evaluate an agent that answers policy questions and retrieves data from connected knowledge sources. The evaluation threshold is set to 0.80.

You run the evaluation and review the following result for one test case:

Expected response: Digital products are non-refundable after download.

Actual response: Digital products cannot be refunded once downloaded.

Result: Pass

Score: 0.92

Reasoning: The actual response semantically matches the expected response.

Knowledge sources used: RefundPolicy_KB

Tools invoked: None

You need to determine whether additional corrective action is required based on the evaluation results.

Which two actions should you perform? Each correct answer presents a complete solution. Choose two.

NOTE: Each correct selection is worth one point.


A.

Rerun the evaluation because the score is below 1.00.


B.

Confirm that the connected knowledge source is functioning as expected.


C.

Investigate external tool configuration for this test case.


D.

Modify the test case because the response is not an exact match.


E.

Accept the result because semantic matching is sufficient for a passing evaluation.


Get Premium AB-620 Questions

Contribute your Thoughts:


Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.