METASTONE launches TokenFleet to schedule LLM inference across GPU clusters and data centers
AIMETASTONE has launched TokenFleet, a distributed scheduling framework that routes LLM inference requests across GPU clusters and data centers to raise effective token output. In slides from the 2026 CCF National High Performance Computing Conference, predicted-latency routing on a tuned GLM5.3 deployment cut P95 time-to-first-token by 32.4%, though the company says none of its figures have been independently verified.
Loading source posts…
Source details
Pandaily · contact@pandaily.com (Pandaily) · pandaily.comPublished · added here