Skip to content
Trending storyDeveloping

vLLM releases v0.32.0 with new endpoint, low-precision KV support and security fixes

1 article1 sourcesince Oct 18Last article 2h ago ·

Overview

AISummary of 1 article

vLLM releases v0.32.0, with 814 commits from 363 contributors, 121 of them first-time contributors, according to the project's X account.

The release adds a /v1/systemone structured-decision endpoint, NVFP4 and 4-bit KV cache support on several hardware platforms, and faster startup. The project reports +43–85% req/s for multi-API workers, a figure it gives without a stated benchmark setup.

Written by AI from the articles below · updated Oct 18, 9:49 AM ET

Check the sources:

Latest developmentOct 18, 9:40 AM ET
vLLM v0.32.0 adds structured decision endpoint and low-precision KV support

Article timeline

The articles in this story. Times are ET.

Oct 18
  1. vLLMOfficial
    vLLM v0.32.0 adds structured decision endpoint and low-precision KV support

    AIvLLM released v0.32.0 with 814 commits from 363 contributors, including 121 first-time contributors. The release adds a /v1/systemone structured-decision endpoint, NVFP4 and 4-bit KV cache support on several hardware platforms, and faster startup with multi-API workers reporting +43–85% req/s.

    Image from @vllm_project's post

Heat Trend

Current comparable heat
9
Peak comparable heat
10Oct 18, 10:00 AM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.