Skip to content
View original post on X: Artificial AnalysisOfficial· 44/100AI score44/100

Nemotron 3.5 Super VL reaches 630 tokens/s at 100k-token prompts

AISummary

Artificial Analysis measured Nemotron 3.5 Super VL at about 630 output tokens/s with 100k-token prompts on a pre-release DeepInfra endpoint serving NVFP4 weights, the fastest of any model scoring 20 or more on the Intelligence Index at that length.

It is about 5x Inkling Small (124 tokens/s), 2.7x Nemotron 3 Ultra (235), and 4.5x Nemotron 3 Super (140), and returns its first token in 1.8s versus 4.4s and 8.5s for Nemotron 3 Ultra and Inkling Small.

Post on XView on X
Artificial AnalysisVerified on X
@ArtificialAnlys

Part of a thread · earlier post

Measured on a pre-release @DeepInfra endpoint serving NVFP4 weights, Nemotron 3.5 Super VL reaches an output speed of ~630 tokens/s with 100k-token prompts. That is the fastest of any model scoring 20 or more on the Intelligence Index that we have measured at this prompt length

That is ~5x Inkling Small (124 tokens/s), ~2.7x Nemotron 3 Ultra (235), and ~4.5x Nemotron 3 Super (140). It also returns its first token in 1.8s, against 4.4s for Nemotron 3 Ultra and 8.5s for Inkling Small

Source: Artificial Analysis · x.comPublished · added here