AWS publishes cost-per-task and agent ROI framework for Bedrock
Start here
AWS's Machine Learning Blog published a framework for judging Amazon Bedrock spending by cost per task rather than cost per token, arguing that tokenizer efficiency, output verbosity, agentic loop count and reasoning overhead can make a lower-priced model cost more in practice. In the post's single worked example, a model with twice the list price finished 65% cheaper per task; the post also recommends caching, routing and output constraints to cut cost per task, and proposes measuring agent ROI against human baselines with holdout experiments and a five-dimension scorecard. A follow-up AWS post details four Bedrock inference settings that change cost without changing the model or prompt: cache duration, service tier, reasoning effort and maxTokens. It states that on Claude Sonnet 5 and Claude Opus 5 a 5-minute cache write costs 1.25x the input rate and a 1-hour write 2x, while cache reads cost 0.1x, and that Flex tier requests to unsupported models fail with a ValidationException. These are the posts' own recommendations and figures, not independent benchmarks.
Generated from reports · updated 17 h ago
Developments
2 developments
- November 13 04:51 · 1 reportsFour Amazon Bedrock inference choices that affect costAWS Machine Learning Blog:Four Amazon Bedrock inference choices that affect cost
- November 13 02:43 · 1 reportsPublishing a framework for cost per task and agent ROI on BeAWS Machine Learning Blog:Optimizing cost per task and proving agent ROI on Amazon Bedrock
Report timeline
Follow the reports to see the event from different sides.
- AWS Machine Learning BlogFour Amazon Bedrock inference choices that affect cost
Amazon Bedrock's cache duration, service tier, reasoning effort, and maxTokens settings can change inference cost without altering the model or prompt. A 5-minute cache write on Claude Sonnet 5 and Claude Opus 5 costs 1.25x the input rate, a 1-hour write costs 2x, and cache reads cost 0.1x; Flex tier requests to unsupported models fail with a ValidationException.
- AWS Machine Learning BlogOptimizing cost per task and proving agent ROI on Amazon Bedrock
This AWS post argues that Amazon Bedrock spend should be judged by cost per task rather than cost per token, since tokenizer efficiency, output verbosity, agentic loop count and reasoning overhead can make a lower-priced model cost more. A worked example shows a model with 2x the list price finishing 65% cheaper per task, and the post adds caching, routing and output constraints plus a five-dimension scorecard for measuring agent ROI against human baselines.
Heat for this event
Not enough continuous observations yet to draw a trend.