SenseTime details Prefill/Decode split clusters for agentic inference

SenseTime SenseCore CTO Xuan Shanming says its 10,000-GPU heterogeneous clusters split Prefill and Decode across mixed domestic and high-bandwidth GPUs, linked by KV Cache over 800G, 400G and 200G fabrics.

The company reports about five times higher token throughput than a baseline with the same count of flagship GPUs, and says its platform serves about 6 trillion tokens per day, targeting 10 trillion by Q4 2026.

These throughput and capacity figures are company statements.