Amazon Web Services AWS Certified AI Practitioner Exam AIF-C01 Question # 40 Topic 5 Discussion

Amazon Web Services AWS Certified AI Practitioner Exam AIF-C01 Question # 40 Topic 5 Discussion

AIF-C01 Exam Topic 5 Question 40 Discussion:
Question #: 40
Topic #: 5

A social media company wants to use a large language model (LLM) to summarize messages. The company has chosen a few LLMs that are available on Amazon SageMaker JumpStart. The company wants to compare the generated output toxicity of these models.

Which strategy gives the company the ability to evaluate the LLMs with the LEAST operational overhead?


A.

Crowd-sourced evaluation


B.

Automatic model evaluation


C.

Model evaluation with human workers


D.

Reinforcement learning from human feedback (RLHF)


Get Premium AIF-C01 Questions

Contribute your Thoughts:


Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.