Skip to content
View original post on X: vLLMOfficial
Published
60/100

vLLM adds day-0 support for Mistral Large 4 with FP8 and NVFP4 checkpoints

AIvLLM announces day-0 support for Mistral Large 4, with Mistral leading the implementation alongside vLLM contributors and Red Hat, inferact and NVIDIA. The post links FP8 and NVFP4 checkpoints, with NVFP4 marked for Blackwell, and a technical deep dive on the blog. The image shows a disaggregated serving layout with prefill and decode stages, NIXL KV handoff, and cross-layer KV sharing and context parallelism.
vLLMVerified on XOfficial
@vllm_project
View on X

Part of a thread · earlier post

Weights:
FP8: https://huggingface.co/mistralai/Mistral-Large-4-1T-A52B
NVFP4 (Blackwell): https://huggingface.co/mistralai/Mistral-Large-4-1T-A52B-NVFP4

Mistral leads the implementation, with vLLM contributors, @RedHat, @inferact and @NVIDIA support work.

Technical deep dive:
https://blog.vllm.ai/2026/10/29/mistral-large-4.html

Source details

vLLM · x.comPublished

Original title: Weights:

Topics

Open-source ecosystemDeployment & engineeringModel releasesProduct updates