Introducing India-based inference for Kimi K3 on Amazon Bedrock
Introducing India-based inference for Kimi K3 on Amazon Bedrock
Amazon Bedrock now supports in-country inference in India for Moonshot AI's multi-modal, open-weight Kimi K3 model via the in.moonshotai.kimi-k3 geographic inference profile, processing requests in the Mumbai and Hyderabad Regions for workloads with strict data residency requirements. The post explains global versus India inference profiles and walks through an example of OCR and document understanding for Indic-language documents, including structured extraction and follow-up questions in code-mixed Hinglish. It also covers prompt caching, service tiers, and CloudWatch monitoring, citing Ultrahuman's report of 80 percent lower LLM costs and 85 percent faster multi-turn chats with prompt caching.
Source: AWS Machine Learning Blog · aws.amazon.com