Skip to content
Read the original: Xiaomi MiMo· Published 62/100AI score62/100

Xiaomi MiMo-V2.5-Pro UltraSpeed claims 1,000+ tokens/s on a 1T model

Original title🚀 1,000+ TOKENS/S ON A 1T MODEL! 🚀

AISummary

Xiaomi MiMo and TileRT released MiMo-V2.5-Pro-UltraSpeed, which the post says reaches output speeds above 1,000 tokens/s on a 1 trillion parameter MoE model. The post says this runs on a single standard 8-GPGPU node rather than wafer-scale or pure on-chip SRAM hardware. UltraSpeed access is application-based from Jun 8 to Jun 23 (PDT), and the UltraSpeed API costs 3x the standard price.

Read the original x.com

Source: Xiaomi MiMo · x.comPublished · added here