Skip to content
AWS Machine Learning Blog· Alan Yao·· 22 h agoAI score34

How Airbnb uses cost per task to operate coding agents on Amazon Bedrock

How Airbnb uses cost per task to operate coding agents on Amazon Bedrock

AI summary

Airbnb runs its internal coding-agent tool AirChat through an LLM gateway on Amazon Bedrock, using cost per task—the list-price cost of all tokens an agent spends to finish one task—to pick model defaults and effort ceilings. After eight new models shipped in about five weeks, roughly two thirds of engineers' coding-agent requests went to those new models by mid-October. Airbnb pairs pre-rollout evals with CloudWatch runtime signals on latency, throttling and token spend to revisit those choices.

Source:AWS Machine Learning Blog · aws.amazon.com