Mistral Large 4 open-weight release and day-0 support from Hugging Face, vLLM and SGLang
Overview
Mistral releases Mistral Large 4 as open weights, a multimodal mixture-of-experts model with about 1T total and 49B active parameters and a 1M-token context window, in FP8 and NVFP4 variants.
Hugging Face says the model is nicknamed Le Chonk and reports 82% on the Artificial Analysis Cyber Index and 61.7% on DeepSWE v1.1. NVIDIA AI says it was trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs and offers NVFP4 weights on Hugging Face.
Support arrived on launch day in several serving stacks. Hugging Face says Transformers v5.22.0 supports the model, and Lewis Tunstall says TRL supports LoRA fine-tuning on a single 8x B300 node. vLLM ships support in the vllm/vllm-openai:mistral-large-4 Docker image and reports about 2x output throughput on a single 8-GPU B200 node with TP8 and the DSpark drafter. SGLang says it has day-0 support, including NVFP4 and DSpark speculative decoding, and that it is the first to serve the model on NVIDIA Vera Rubin.
Written by AI from the articles below · updated Oct 29, 11:41 AM ET
Check the sources:
Developments
8 developments
- Oct 29, 11:30 AM ET · 1 articleHugging Face interviews Mistral on launch day of Mistral Large 4Hugging Face: Hugging Face interviews Mistral on launch day of Mistral Large 4
- Oct 29, 10:46 AM ET · 1 articleMistral releases open weights for Le Chonk, a 1T-parameter MoE multimodal modelNVIDIA AI: NVIDIA AI supports Mistral's new open Le Chonk model at launch
- Oct 29, 10:38 AM ET · 1 articleHugging Face's TRL adds day-0 LoRA SFT support for Mistral's 1T-parameter Le Chonk on a single nodeLewis Tunstall: Hugging Face TRL adds day-0 support for post-training Le Chonk on one node
- Oct 29, 10:37 AM ET · 1 articleTransformers v5.22.0 released with Mistral Large 4 supportJulien Chaumond: Hugging Face releases Transformers v5.22.0 with Mistral Large 4 support
- Oct 29, 10:25 AM ET · 1 articleSGLang adds a cookbook guide for serving Mistral Large 4SGLang: SGLang adds a cookbook guide for serving Mistral Large 4
- Oct 29, 10:24 AM ET · 2 articlesSGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera RubinSGLang: SGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera Rubin
- Oct 28, 8:00 PM ET · 1 articleMistral releases Mistral Large 4, an open-weight multimodal MoE model, on Hugging FaceHugging Face Blog: Hugging Face introduces Mistral Large 4 with open weights and day-0 support
- Oct 28, 8:00 PM ET · 3 articlesvLLM adds day-0 support for Mistral Large 4vLLM Blog: vLLM adds day-0 support for Mistral Large 4 with DSpark and NVFP4
Article timeline
The articles in this story. Times are ET.
NVIDIA AI@NVIDIAAIOfficialSGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera RubinAISGLang says it provides Day-0 support for Mistral Large 4, which it calls Le Chonk, and is the first to serve it on NVIDIA Vera Rubin. The quoted post describes it as a natively multimodal 1T MoE model with a 1M context window, and says Vera Rubin, NVFP4, and DSpark speculative decoding are supported on Day 0.
Hugging Face@huggingfaceOfficialHugging Face interviews Mistral on launch day of Mistral Large 4AIHugging Face spoke with Mistral's Pierre Stock and Sagar Vaze on the launch day of Mistral Large 4. The post says the model has open weights, was trained in Mistral's own data centers, and excels at cyber tasks. The full conversation covers cyber, training, evals and sandboxing.
vLLM@vllm_projectOfficialvLLM adds day-0 support for Mistral Large 4 with FP8 and NVFP4 checkpointsAIvLLM announces day-0 support for Mistral Large 4, with Mistral leading the implementation alongside vLLM contributors and Red Hat, inferact and NVIDIA. The post links FP8 and NVFP4 checkpoints, with NVFP4 marked for Blackwell, and a technical deep dive on the blog. The image shows a disaggregated serving layout with prefill and decode stages, NIXL KV handoff, and cross-layer KV sharing and context parallelism.

vLLM@vllm_projectOfficialPickvLLM adds day-0 support for Mistral Large 4 with 1M contextAIvLLM says it offers day-0 support for Mistral Large 4, a trillion-parameter multimodal mixture-of-experts model with a 1M-token context window. The model targets coding, reasoning and cybersecurity tasks and ships FP8 and NVFP4 checkpoints with a built-in DSpark drafter.

NVIDIA AI@NVIDIAAIOfficialNVIDIA AI supports Mistral's new open Le Chonk model at launchAINVIDIA AI congratulates Mistral on the next-generation Le Chonk, a 1T-parameter MoE multimodal model trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs. It offers day 0 support, including NVFP4 weights on Hugging Face and scaled distributed inference using Dynamo.
Lewis Tunstall@_lewtunXPickHugging Face TRL adds day-0 support for post-training Le Chonk on one nodeAILewis Tunstall says TRL supports post-training Mistral's Le Chonk on a single node, using LoRA SFT on a 1T-parameter model with adapters on FP8 weights. He reports 32.7k tokens per step in about 8 seconds and 142 GiB per GPU on 8× B300, using expert parallelism and FSDP. The post links a training recipe on GitHub.
Julien Chaumond@julien_cOfficialHugging Face releases Transformers v5.22.0 with Mistral Large 4 supportAIHugging Face releases Transformers v5.22.0, which includes support for Mistral's Large 4 model. The post's only other detail is the model's nickname, Le Chonk.

SGLang@sgl_projectOfficialSGLang adds a cookbook guide for serving Mistral Large 4AISGLang says users can now serve Mistral Large 4 with SGLang, linking to a cookbook guide on its documentation site. The post gives no further details on performance, hardware, or setup steps.
SGLang@sgl_projectOfficialPickSGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera RubinAISGLang says it has Day-0 support for Mistral Large 4, also called Le Chonk, and is the first to serve it on NVIDIA Vera Rubin. The post says Vera Rubin, NVFP4, and DSpark speculative decoding are all supported on Day 0. Mistral describes the model as a natively multimodal 1T MoE with a 1M context window, and says it has open-weight state of the art for security work.

- Hugging Face BlogOfficialPickHugging Face introduces Mistral Large 4 with open weights and day-0 support
AIHugging Face says Mistral Large 4, nicknamed Le Chonk, is a multimodal Mixture-of-Experts model with about 1T total and 49B active parameters and a 1M-token context window. The model is released in FP8 and NVFP4 variants, with GGUF quants from Unsloth and the llama.cpp team, and day-0 support in transformers, vLLM, and llama.cpp. The post reports 82% on the Artificial Analysis Cyber Index and 61.7% on DeepSWE v1.1.
- vLLM BlogOfficialPickvLLM adds day-0 support for Mistral Large 4 with DSpark and NVFP4
AIvLLM announces day-0 support for Mistral Large 4, a 1-trillion-parameter mixture-of-experts multimodal model with 49 billion active parameters per token. The post reports about 2x output throughput on TP8 with the built-in DSpark drafter and about 1.5x more KV cache with the NVFP4 checkpoint, which stays within 2.1 points of FP8 on evaluated tasks.
Heat Trend
Not enough continuous observations to show a trend yet.