Oracle Cloud Infrastructure 2025 Generative AI Professional 1z0-1127-25 Question # 19 Topic 2 Discussion
1z0-1127-25 Exam Topic 2 Question 19 Discussion:
Question #: 19
Topic #: 2
Which statement describes the difference between "Top k" and "Top p" in selecting the next token in the OCI Generative AI Generation models?
A.
"Top k" and "Top p" are identical in their approach to token selection but differ in their application of penalties to tokens.
B.
"Top k" selects the next token based on its position in the list of probable tokens, whereas "Top p" selects based on the cumulative probability of the top tokens.
C.
"Top k" considers the sum of probabilities of the top tokens, whereas "Top p" selects from the "Top k" tokens sorted by probability.
D.
"Top k" and "Top p" both select from the same set of tokens but use different methods to prioritize them based on frequency.
“Top k” sampling selects from the k most probable tokens, based on their ranked position, while “Top p” (nucleus sampling) selects from tokens whose cumulative probability exceeds p, focusing on a dynamic probability mass—Option B is correct. Option A is false—they differ in selection, not penalties. Option C reverses definitions. Option D (frequency) is incorrect—both use probability, not frequency. This distinction affects diversity.
OCI 2025 Generative AI documentation likely contrasts Top k and Top p under sampling methods.
Contribute your Thoughts:
Chosen Answer:
This is a voting comment (?). You can switch to a simple comment. It is better to Upvote an existing comment if you don't have anything to add.
Submit