The post gives the quantized file size, the accuracy retention figure, and the local runtime, which helps readers judge whether the model fits their hardware.
Mistral Large 4 is here! We made some Unsloth quants & tested across many domains! 1bit retains 91% of top-1 accuracy across coding, agentic tasks, math etc whilst being 80% smaller (223GB vs 1.1TB FP8)
They all work in Unsloth Desktop now! Thank you Mistral for day zero access!
Mistral Le Chonk can now run locally! The 1 trillion parameter model runs on a Mac Studio with our 1-bit GGUF which retains 91% top-1 accuracy. Le Chonk is the strongest Western open model to date. GGUF: https://huggingface.co/unsloth/Mistral-Large-4-1T-A52B-GGUF Guide: https://unsloth.ai/docs/models/mistral-large-4
Daniel Han · x.comPublished
Original title: Mistral Large 4 is here! We made some Unsloth quants & tested across many domains! 1bit retains 91% of top-1 accuracy across coding, agen...
