Today, @Kimi_Moonshot launched Kimi K3.1 Pro, and we are announcing an expanded partnership with Moonshot AI to bring the Kimi model series to production with vLLM.
Kimi K3.1 Pro is available on the Inferact Platform from launch. We held it to the same standard as Kimi K3, which we brought onto the platform after completing final qualification and Kimi Vendor Verification.
Inferact also partners with Moonshot AI on @vllm_project support for each Kimi release. For Kimi K3.1 Pro, developers can serve the model in vLLM today.
Our work with Moonshot AI on each model starts before release. We tune and validate the model serving path together, then ship improvements to the community, such as a speculative decoding model that raises generation throughput. What we learn serving Kimi in production is upstreamed to vLLM.
Thank you to the Moonshot AI team for the partnership. Read the full announcement:
https://inferact.ai/news/moonshot-partnership