Skip to content
Trending storyDeveloping

Mistral Large 4 open-weight release and day-0 support from Hugging Face, vLLM and SGLang

11 articles8 sourcessince Oct 28Last article 1h ago ·

Overview

AISummary of 11 articles

Mistral releases Mistral Large 4 as open weights, a multimodal mixture-of-experts model with about 1T total and 49B active parameters and a 1M-token context window, in FP8 and NVFP4 variants.

Hugging Face says the model is nicknamed Le Chonk and reports 82% on the Artificial Analysis Cyber Index and 61.7% on DeepSWE v1.1. NVIDIA AI says it was trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs and offers NVFP4 weights on Hugging Face.

Support arrived on launch day in several serving stacks. Hugging Face says Transformers v5.22.0 supports the model, and Lewis Tunstall says TRL supports LoRA fine-tuning on a single 8x B300 node. vLLM ships support in the vllm/vllm-openai:mistral-large-4 Docker image and reports about 2x output throughput on a single 8-GPU B200 node with TP8 and the DSpark drafter. SGLang says it has day-0 support, including NVFP4 and DSpark speculative decoding, and that it is the first to serve the model on NVIDIA Vera Rubin.

Written by AI from the articles below · updated Oct 29, 11:41 AM ET

Check the sources:

Developments

8 developments

  1. Oct 29, 11:30 AM ET · 1 article
    Hugging Face interviews Mistral on launch day of Mistral Large 4
    Hugging Face: Hugging Face interviews Mistral on launch day of Mistral Large 4
  2. Oct 29, 10:46 AM ET · 1 article
    Mistral releases open weights for Le Chonk, a 1T-parameter MoE multimodal model
    NVIDIA AI: NVIDIA AI supports Mistral's new open Le Chonk model at launch
  3. Oct 29, 10:38 AM ET · 1 article
    Hugging Face's TRL adds day-0 LoRA SFT support for Mistral's 1T-parameter Le Chonk on a single node
    Lewis Tunstall: Hugging Face TRL adds day-0 support for post-training Le Chonk on one node
  4. Oct 29, 10:37 AM ET · 1 article
    Transformers v5.22.0 released with Mistral Large 4 support
    Julien Chaumond: Hugging Face releases Transformers v5.22.0 with Mistral Large 4 support
  5. Oct 29, 10:25 AM ET · 1 article
    SGLang adds a cookbook guide for serving Mistral Large 4
    SGLang: SGLang adds a cookbook guide for serving Mistral Large 4
  6. Oct 29, 10:24 AM ET · 2 articles
    SGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera Rubin
    SGLang: SGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera Rubin
  7. Oct 28, 8:00 PM ET · 1 article
    Mistral releases Mistral Large 4, an open-weight multimodal MoE model, on Hugging Face
    Hugging Face Blog: Hugging Face introduces Mistral Large 4 with open weights and day-0 support
  8. Oct 28, 8:00 PM ET · 3 articles
    vLLM adds day-0 support for Mistral Large 4
    vLLM Blog: vLLM adds day-0 support for Mistral Large 4 with DSpark and NVFP4

Article timeline

The articles in this story. Times are ET.

Oct 29
  1. NVIDIA AIOfficial
    SGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera Rubin

    AISGLang says it provides Day-0 support for Mistral Large 4, which it calls Le Chonk, and is the first to serve it on NVIDIA Vera Rubin. The quoted post describes it as a natively multimodal 1T MoE model with a 1M context window, and says Vera Rubin, NVFP4, and DSpark speculative decoding are supported on Day 0.

  2. Hugging FaceOfficial
    Hugging Face interviews Mistral on launch day of Mistral Large 4

    AIHugging Face spoke with Mistral's Pierre Stock and Sagar Vaze on the launch day of Mistral Large 4. The post says the model has open weights, was trained in Mistral's own data centers, and excels at cyber tasks. The full conversation covers cyber, training, evals and sandboxing.

  3. vLLMOfficial
    vLLM adds day-0 support for Mistral Large 4 with FP8 and NVFP4 checkpoints

    AIvLLM announces day-0 support for Mistral Large 4, with Mistral leading the implementation alongside vLLM contributors and Red Hat, inferact and NVIDIA. The post links FP8 and NVFP4 checkpoints, with NVFP4 marked for Blackwell, and a technical deep dive on the blog. The image shows a disaggregated serving layout with prefill and decode stages, NIXL KV handoff, and cross-layer KV sharing and context parallelism.

    Image from @vllm_project's post
  4. vLLMOfficialPick
    vLLM adds day-0 support for Mistral Large 4 with 1M context

    AIvLLM says it offers day-0 support for Mistral Large 4, a trillion-parameter multimodal mixture-of-experts model with a 1M-token context window. The model targets coding, reasoning and cybersecurity tasks and ships FP8 and NVFP4 checkpoints with a built-in DSpark drafter.

    Image from @vllm_project's post
  5. NVIDIA AIOfficial
    NVIDIA AI supports Mistral's new open Le Chonk model at launch

    AINVIDIA AI congratulates Mistral on the next-generation Le Chonk, a 1T-parameter MoE multimodal model trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs. It offers day 0 support, including NVFP4 weights on Hugging Face and scaled distributed inference using Dynamo.

  6. Lewis TunstallXPick
    Hugging Face TRL adds day-0 support for post-training Le Chonk on one node

    AILewis Tunstall says TRL supports post-training Mistral's Le Chonk on a single node, using LoRA SFT on a 1T-parameter model with adapters on FP8 weights. He reports 32.7k tokens per step in about 8 seconds and 142 GiB per GPU on 8× B300, using expert parallelism and FSDP. The post links a training recipe on GitHub.

  7. Julien ChaumondOfficial
    Hugging Face releases Transformers v5.22.0 with Mistral Large 4 support

    AIHugging Face releases Transformers v5.22.0, which includes support for Mistral's Large 4 model. The post's only other detail is the model's nickname, Le Chonk.

    Image from @julien_c's post
  8. SGLangOfficial
    SGLang adds a cookbook guide for serving Mistral Large 4

    AISGLang says users can now serve Mistral Large 4 with SGLang, linking to a cookbook guide on its documentation site. The post gives no further details on performance, hardware, or setup steps.

  9. SGLangOfficialPick
    SGLang adds Day-0 support for Mistral Large 4 on NVIDIA Vera Rubin

    AISGLang says it has Day-0 support for Mistral Large 4, also called Le Chonk, and is the first to serve it on NVIDIA Vera Rubin. The post says Vera Rubin, NVFP4, and DSpark speculative decoding are all supported on Day 0. Mistral describes the model as a natively multimodal 1T MoE with a 1M context window, and says it has open-weight state of the art for security work.

    Image from @sgl_project's post
Oct 28
  1. Hugging Face BlogOfficialPick
    Hugging Face introduces Mistral Large 4 with open weights and day-0 support

    AIHugging Face says Mistral Large 4, nicknamed Le Chonk, is a multimodal Mixture-of-Experts model with about 1T total and 49B active parameters and a 1M-token context window. The model is released in FP8 and NVFP4 variants, with GGUF quants from Unsloth and the llama.cpp team, and day-0 support in transformers, vLLM, and llama.cpp. The post reports 82% on the Artificial Analysis Cyber Index and 61.7% on DeepSWE v1.1.

  2. vLLM BlogOfficialPick
    vLLM adds day-0 support for Mistral Large 4 with DSpark and NVFP4

    AIvLLM announces day-0 support for Mistral Large 4, a 1-trillion-parameter mixture-of-experts multimodal model with 49 billion active parameters per token. The post reports about 2x output throughput on TP8 with the built-in DSpark drafter and about 1.5x more KV cache with the NVFP4 checkpoint, which stays within 2.1 points of FP8 on evaluated tasks.

Heat Trend

Not enough continuous observations to show a trend yet.

Related stories