Skip to content
Trending storyDeveloping

vLLM adds Day-0 serving support for NVIDIA Nemotron 3.5 Super VL

2 articles1 sourcesince Oct 15Last article 1h ago ·

Overview

AISummary of 2 articles

vLLM announces Day-0 support for NVIDIA Nemotron 3.5 Super VL, an open multimodal model with 120B total parameters, 12B active per token, and a 1M-token context window.

The model accepts text, images, documents and video, and supports reasoning and tool use for agent workflows.

vLLM publishes a serving guide that starts from its v0.31.0 Docker image. Its 1x GB200 NVFP4 example uses a 114,688-token maximum model length, the nemotron_v3 reasoning parser, and multi-token prediction (MTP) with 5 speculative tokens. vLLM advises users to validate the configuration on their target hardware and points to a cookbook from NVIDIA's Nemotron team.

Written by AI from the articles below · updated Oct 15, 12:02 PM ET

Check the sources:

Developments

2 developments

  1. Oct 15, 11:50 AM ET · 1 article
    vLLM publishes Day-0 serving guide for Nemotron 3.5 Super VL
    vLLM: vLLM supports Nemotron 3.5 Super VL with a day-0 serving recipe
  2. Oct 15, 11:50 AM ET · 1 article
    vLLM adds day-0 support for NVIDIA Nemotron 3.5 Super VL
    vLLM: vLLM adds Day-0 support for NVIDIA Nemotron 3.5 Super VL

Article timeline

The articles in this story. Times are ET.

Oct 15
  1. vLLMOfficial
    vLLM supports Nemotron 3.5 Super VL with a day-0 serving recipe

    AIvLLM says Nemotron 3.5 Super VL can be served from its v0.31.0 Docker image on day zero. The blog gives a 1x GB200 NVFP4 example with a 114,688-token maximum model length, the nemotron_v3 reasoning parser, and MTP with 5 speculative tokens. vLLM advises validating the configuration on the target hardware, and points to a cookbook from NVIDIA's Nemotron team.

    Image from @vllm_project's post
  2. vLLMOfficial
    vLLM adds Day-0 support for NVIDIA Nemotron 3.5 Super VL

    AIvLLM announces Day-0 support for NVIDIA Nemotron 3.5 Super VL, an open multimodal model with 120B total parameters, 12B active per token, and a 1M-token context window. The model handles text, images, documents, and video, with reasoning and tool use for agent workflows.

    Image from @vllm_project's post

Heat trend

Not enough continuous observations to show a trend yet.