AWS Machine Learning Blog· Dustin Liu·· 1 h agoAI score38
Using prompt caching with open-weight models on Amazon Bedrock
Use prompt caching with open-weight models on Amazon Bedrock
AI summary
Amazon Bedrock's open-weight models now support explicit prompt caching alongside automatic implicit caching, letting applications reuse a matching prompt prefix across requests instead of reprocessing it. Cache reads are billed at a lower rate than standard input, and the post demonstrates both modes through the Chat Completions API plus implicit caching in an OpenCode coding agent session.
Source:AWS Machine Learning Blog · aws.amazon.com