You are operating an interactive assistant whose dominant performance constraint is per-turn latency. Quality on routine turns is already acceptable.
Which configuration adjustment most directly improves latency without disproportionately damaging quality?
Submit