iCreatAI News
Skip to content
Trending storyUpdating

Accenture optimizes token costs on Bedrock

1 reports1 sources17 hr agoUpdated

Understand this story

AI overview

Accenture applied six token optimization techniques on Amazon Bedrock, reducing token spending by roughly 40–85% across four customer projects in telecommunications, insurance, mining, and large enterprise. The AWS Machine Learning Blog describes these practices and notes that results vary by customer workload. AWS gives the effect of each individual technique as follows: caching input tokens reduces costs by up to 90% on supported models; batch inference processes non-urgent tasks asynchronously at up to 50% below on-demand pricing on some models; and intelligent prompt routing reduces costs by up to 30% without harming accuracy.

AI overview based on source reports · Updated 16 hr ago

Coverage timeline

Follow the coverage to explore different perspectives.

Nov 20
  1. AWS Machine Learning Blog
    Optimize AI economics on Amazon Bedrock with Accenture’s sequenced approach

    This AWS and Accenture post describes six levers for reducing token spend on Amazon Bedrock, organized into three phases: configuration-only changes (prompt caching, batch inference), architectural changes (intelligent prompt routing, RAG optimization, context scoping and compression), and infrastructure and training investment (semantic caching, model distillation). Accenture applied these levers in four client engagements across telecom, insurance, mining, and a large enterprise deployment, with token spend falling by about 40–85 percent where savings were measured, though results are client-specific and may vary. The post also covers cost attribution through application inference profiles and cost allocation tags, the Cost per Business Transaction framework, and four production governance tenets.

Activity for this story

Current comparable activity
6
Peak comparable activity
10Nov 20 04:00
Change in the past 24 hours
–

Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.