Skip to content
AWS Machine Learning Blog· Dustin Liu·· 1 h agoAI score38

Using prompt caching with open-weight models on Amazon Bedrock

Use prompt caching with open-weight models on Amazon Bedrock

AI summary

Amazon Bedrock's open-weight models now support explicit prompt caching alongside automatic implicit caching, letting applications reuse a matching prompt prefix across requests instead of reprocessing it. Cache reads are billed at a lower rate than standard input, and the post demonstrates both modes through the Chat Completions API plus implicit caching in an OpenCode coding agent session.

Source:AWS Machine Learning Blog · aws.amazon.com