vLLM v0.33.0 is out! 🚀
927 commits · 389 contributors · 122 first-timers
🤖 New models: Reflection Beam-1.0, Step-5 Preview, Nemotron Parse 3.5, MiniCPM-OCR 1.0
🔥 PyTorch 2.14 — CUDA 13.0-only wheels, libtorch ABI-stable
🎲 Spec decoding: XPress refiner, FLy lossy verify (1.04–1.31x), DSpark 1373→3390 tok/s on GB300
⚡ NVIDIA decode: 1.5–2x latency decode on GB300, FA4 sparse MLA, 39–48% lower TTFT
🚀 New AWS EFA image + shorter vllm/vllm name
🐧 ROCm 10.0 default, MonoKernel 2.32x P50
Full notes ➡️ http://github.com/vllm-project/vllm/releases/tag/v0.33.0