Daniel Han says Unsloth has released UD-3 quants of Meta's Muse Spark Open, with the smallest UD-IQ1_S file at 176GB. Unsloth also ran KLD benchmarks to measure how much accuracy the smaller quants retain. The model is fully multimodal and can run in Unsloth Desktop.
Muse Spark Open from Meta is here! We made Unsloth UD-3 quants for the model with UD-IQ1_S being 176GB
We also did some KLD benchmarks and recovered as much accuracy as we could for the smaller quants!
Muse Spark Open is fully multimodal and works in Unsloth Desktop!
Meta releases Muse Spark Open, a new SOTA open model. Run on a Mac Studio via Dynamic 2-bit Unsloth GGUFs. Muse-Spark-Open-816B-A42B supports text, images, video and audio input with 1M context. GGUF: https://huggingface.co/unsloth/Muse-Spark-Open-816B-A42B-GGUF Guide: https://unsloth.ai/docs/models/muse-spark-open
Source: Daniel Han · x.comPublished · added here
