Skip to content
Trending storyDeveloping

AWS adds India-based inference for Kimi K3 on Amazon Bedrock

1 article1 sourcesince Nov 3Last article 2h ago ·

Overview

AISummary of 1 article

AWS says Kimi K3, an open-weight multimodal model from Moonshot AI, now runs on Amazon Bedrock with in-country inference in India.

Customers with strict data residency requirements can use the India geographic inference profile, which keeps processing within the Mumbai and Hyderabad Regions. Bedrock already offered global and US-based inference for the model, and AWS says the global profile gives the lowest cost and broadest availability.

AWS's blog post also cites Ultrahuman, which says prompt caching on the model cut its LLM costs 80 percent.

Written by AI from the articles below · updated Nov 3, 12:24 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 3
  1. AWS Machine Learning BlogOfficial
    Amazon Bedrock adds India-based inference for Kimi K3 open-weight model

    AIAWS says Kimi K3, a multimodal open-weight foundation model from Moonshot AI, now runs on Amazon Bedrock with in-country inference in India for workloads with strict data residency requirements. Customers can use the India geographic inference profile, which keeps processing within the Mumbai and Hyderabad Regions, or the global profile for lowest cost and broadest availability. Ultrahuman says it cut LLM costs 80 percent with prompt caching on the model.

Heat Trend

Not enough continuous observations to show a trend yet.