Skip to content
AWS Machine Learning Blog· Shubham Gupta·· 8 h agoAI score38

How ArisGlobal scaled generative AI inference on Amazon Bedrock

How ArisGlobal scaled generative AI inference on Amazon Bedrock

AI summary

ArisGlobal reversed the prompt order in its NavaX AI engine on Amazon Bedrock, caching the shared prompt prefix instead of each source document to cut effective input costs. The shared prefix grew from about 72,000 to 180,000 tokens in 6 months, pushing per-case inference costs up more than 200%. NavaX has processed over 1 million real transactions in regulated pharmaceutical environments since its first Amazon Bedrock deployment with Anthropic's Claude in March 2025.

Source:AWS Machine Learning Blog · aws.amazon.com