To maximize answer accuracy (reduce randomness and hallucinations) with Azure OpenAI GPT-3.5, you should lower the sampling randomness. The primary control for this is temperature:
Temperature controls how “creative” or random the model is.
Lower values → more deterministic, focused, and conservative outputs.
temperature = 0 makes the model pick the highest-probability tokens, which typically yields the most accurate and repeatable responses for transactional bots like booking/reservations.
Top P (nucleus sampling) is an alternative to temperature. Microsoft recommends using one or the other. While reducing Top P also narrows randomness, the clearest and most common approach for maximizing accuracy is setting temperature to 0. Setting Top P to 0 is generally not recommended and may be invalid depending on the SDK.
System message tuning (Option D) helps with tone, role, and policy adherence, but does not itself guarantee factual accuracy if decoding randomness remains high.
Including the travel agent’s database (Option A) would require Azure OpenAI on your data or a RAG pattern. That can improve grounding of facts, but it’s not a model parameter change and is outside the scope of simply configuring GPT-3.5; moreover, accuracy still benefits from low temperature even when using your own data.
Therefore, the best single action here is: set Temperature to 0.
Microsoft Azure AI Solution References
Azure OpenAI Service – Chat Completions parameters (Temperature and Top P): “Lower values like 0.2 will make the output more focused and deterministic… use either temperature or top_p but generally not both.”https://learn.microsoft.com/azure/ai-services/openai/reference#chat-completions
Prompt engineering with Azure OpenAI – controlling randomness and determinism:https://learn.microsoft.com/azure/ai-services/openai/concepts/prompt-engineering
Azure OpenAI on your data (grounding with enterprise data/RAG):https://learn.microsoft.com/azure/ai-services/openai/concepts/use-your-data
=========================
Contribute your Thoughts:
Chosen Answer:
This is a voting comment (?). You can switch to a simple comment. It is better to Upvote an existing comment if you don't have anything to add.
Submit