# Samsung researchers propose hot/cold hints for HiCache KV placement

> Original title: Vasanthi Jagatha + Somnath Roy (@SamsungUS) on memory-accelerated prefix serving for HiCache.

- Source: LMSYS Org
- Published: 2026-11-09T23:15:39.000Z
- Bad Influence: https://badinfluence.news/items/gxz2mpe99myp3c8lw45zqalru
- Original: https://x.com/lmsysorg/status/2119931955609571594

## Summary

Vasanthi Jagatha and Somnath Roy of Samsung propose lightweight hot/cold hints that guide KV placement, promotion and demotion across memory tiers for memory-accelerated prefix serving in HiCache. The hints work without changing the existing API.

## Post

Vasanthi Jagatha + Somnath Roy (@SamsungUS) on memory-accelerated prefix serving for HiCache.

Their proposed lightweight hot/cold hints guide KV placement, promotion and demotion across memory tiers without changing the existing API.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHWuB2GEbsAE1FVm.jpg&mode=thumb&exp=1794528000&sig=7487b270e76d1b63)