Skip to content
View original post on X: Unsloth AIOfficial
Published
46/100

Unsloth makes DeepSeek V4.1-Flash-1017 run locally with 1-bit quantization

AIUnsloth says DeepSeek V4.1-Flash-1017 now runs locally in a 1-bit quantized GGUF, cutting size from 508GB to 250GB (−52%). The company says the quantized model retains about 88.2% accuracy and needs a device with 128GB+ RAM.
Unsloth AIVerified on XOfficial
@UnslothAI
View on X

DeepSeek V4.1-Flash-1017 can now run locally! 🐳

We made 1-bit retain ~88.2% accuracy while shrinking size from 508GB to 250GB (−52%).

Run on a 128GB+ RAM device.

V4.1 Flash 1017 is the strongest open model to date

Guide: https://unsloth.ai/docs/models/deepseek-v4.1-flash
GGUF: https://huggingface.co/unsloth/DeepSeek-V4.1-Flash-1017-GGUF

DeepSeek@deepseek_ai
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
View quoted post on X
Source details

Unsloth AI · x.comPublished · added here

Original title: DeepSeek V4.1-Flash-1017 can now run locally! 🐳

Topics

DeepSeekOn-device AIOpen-source ecosystemChina AITutorials & how-to