Xiaomi MiMo-V2.5-Pro UltraSpeed claims 1,000+ tokens/s on a 1T model
Original title🚀 1,000+ TOKENS/S ON A 1T MODEL! 🚀
AISummary
Xiaomi MiMo and TileRT released MiMo-V2.5-Pro-UltraSpeed, which the post says reaches output speeds above 1,000 tokens/s on a 1 trillion parameter MoE model. The post says this runs on a single standard 8-GPGPU node rather than wafer-scale or pure on-chip SRAM hardware. UltraSpeed access is application-based from Jun 8 to Jun 23 (PDT), and the UltraSpeed API costs 3x the standard price.
Source: Xiaomi MiMo · x.comPublished · added here