Skip to content
View original post on X: Unsloth AIOfficial
Published
Pick75/100

Unsloth shows how to run Mistral's Le Chonk locally with 1-bit GGUF

AIUnsloth says its 1-bit GGUF version of Mistral Le Chonk, a 1 trillion parameter model, runs on a Mac Studio and retains 91% top-1 accuracy. The guide lists hardware requirements from 256-270GB for 1-bit to 1.2TB for 8-bit, and the smallest 1-bit quant, UD-IQ1_S, uses about 233GB of disk space.

AIWhy it matters.

The post gives memory requirements for each quantization level, which helps readers judge whether the 1-trillion-parameter model fits their hardware.

Unsloth AIVerified on XOfficial
@UnslothAI
View on X

Mistral Le Chonk can now run locally!

The 1 trillion parameter model runs on a Mac Studio with our 1-bit GGUF which retains 91% top-1 accuracy.

Le Chonk is the strongest Western open model to date.

GGUF: https://huggingface.co/unsloth/Mistral-Large-4-1T-A52B-GGUF
Guide: https://unsloth.ai/docs/models/mistral-large-4

Mistral AI@MistralAI
Today, we release the weights of a new and improved Le Chonk, advancing the open frontier for agentic coding and cybersecurity. 💻 Built to build: Le Chonk ranks #1 on @cognition’s FrontierCode among open models, and sets a new benchmark for Pareto efficiency on @artificialanalysis. 🛡 Built to defend: State-of-the-art in cyberdefense, put through the paces by the world's leading cyber vendors, including @CrowdStrike, @cloudflare, @rubrik, @zscaler, and others. Built for sovereignty: Make it yours. Download the weights on @huggingface , customize it with Mistral Forge, and deploy it wherever you need it. Read more from our team and customers 👇:
View quoted post on X
Source details

Unsloth AI · x.comPublished · added here

Original title: Mistral Le Chonk can now run locally!