# vLLM details K3.1 serving with token-sharded prefill and fused decode

> Original title: K3.1 combines DSA sparse attention with recurrent Kimi Delta Attention.

- Source: vLLM
- Published: 2026-11-04T16:07:53.000Z
- Bad Influence: https://badinfluence.news/items/huvejqwuq97e8o6t8dojjaixr
- Original: https://x.com/vllm_project/status/2118012367145742491

## Summary

vLLM says K3.1 combines DSA sparse attention with recurrent Kimi Delta Attention, storing MLA latents, indexer keys and KDA state in one packed cache. Its serving work adds token-sharded prefill, exact top-k merging for decode context parallelism, and a fused low-latency decode path.

## Post

K3.1 combines DSA sparse attention with recurrent Kimi Delta Attention.

One packed cache holds MLA latents, indexer keys and KDA state. The serving work adds token-sharded prefill, exact top-k merging for decode context parallelism, and a fused low-latency decode path.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWSxBkkaAAARcIa.jpg&mode=thumb&exp=1794009600&sig=46835c15a9cd05a4)