vLLM announces a Docker image, a serving recipe and a blog post for Beam, a model it says is ready to serve. In a chat test at concurrency 16, 4× B300 NVFP4 TP4 reached 1,769 output tok/s and 8× B300 FP8 TP8 reached 1,300 tok/s. The post notes the two setups use different GPU counts and precisions, so the figures are not an equal-resource comparison.
Part of a thread · earlier post
Ready to serve Beam:
Docker image: vllm/vllm-openai:reflection-beam
Recipe: https://recipes.vllm.ai/reflection/Beam-1.0-501B-A23B
Blog: https://vllm.ai/blog/2026-10-16-reflection-beam
In the chat test at concurrency 16, 4× B300 NVFP4 TP4 delivered 1,769 output tok/s; 8× B300 FP8 TP8 delivered 1,300. These use different GPU counts and precisions, with BF16 KV and variable output lengths.
6/6
Source: vLLM · x.comPublished · added here
