A global financial services company hosts a fraud-alert system that uses an Amazon Bedrock foundation model (FM) to generate explanations for suspicious transactions. The company processes regulated financial data across three geographic areas. The system must maintain consistent responsiveness globally, support multi-Region failover, and provide full observability for audit and compliance teams.
Load testing shows that the FM’s total inference time cannot be reduced. The company cannot increase its inference costs, change the FM, modify token counts, or provision additional compute capacity. Users report that the UI performs slowly because it waits for the complete model response before it shows any content.
The company must improve perceived responsiveness during peak periods, when the system can receive 10,000–15,000 concurrent requests. The solution must maintain multi-Region resiliency and full monitoring visibility.
Which solution will meet these requirements?
Submit