iCreatAI News
Skip to content
AWS Machine Learning Blog· Dustin Liu·· 1 days agoAI score42

Introducing explicit prompt caching with open-weight models on Amazon Bedrock

Introducing explicit prompt caching with open-weight models on Amazon Bedrock

AI summary

Amazon Bedrock now supports explicit prompt caching for open-weight models, letting applications mark reusable prompt prefixes with cache breakpoints so repeated context is read from cache instead of reprocessed, reducing input costs and latency. The post demonstrates implicit and explicit caching through the Chat Completions API, shows how to read cache usage fields from each response, and applies implicit caching to an OpenCode coding agent session. It closes with best practices such as placing static content first, keeping prefixes above the model's minimum token length, and confirming cache hits via usage fields and runtime metrics.

Source: AWS Machine Learning Blog · aws.amazon.com