iCreatAI News
Skip to content
AWS Machine Learning Blog· Naomi Teng·· 3 days agoAI score28

Introducing India-based inference for Kimi K3 on Amazon Bedrock

Introducing India-based inference for Kimi K3 on Amazon Bedrock

AI summary

Amazon Bedrock now supports in-country inference in India for Moonshot AI's multi-modal, open-weight Kimi K3 model via the in.moonshotai.kimi-k3 geographic inference profile, processing requests in the Mumbai and Hyderabad Regions for workloads with strict data residency requirements. The post explains global versus India inference profiles and walks through an example of OCR and document understanding for Indic-language documents, including structured extraction and follow-up questions in code-mixed Hinglish. It also covers prompt caching, service tiers, and CloudWatch monitoring, citing Ultrahuman's report of 80 percent lower LLM costs and 85 percent faster multi-turn chats with prompt caching.

Source: AWS Machine Learning Blog · aws.amazon.com