Muse-Spark-Open 816B GGUF runs locally via llama.cpp on Mac hardware
Overview
Hugging Face CEO Clément Delangue posted a llama serve command that runs the ggml-org/Muse-Spark-Open-816B-A42B-GGUF model at Q2_K quantization on two Mac Studios, crediting @finkd and @johnternus for the setup.
Hugging Face's Merve Noyan later shared a llama.cpp command for the same Q2_K GGUF, saying it pairs well with the pi.dev agent and showing a demo running on a Mac M3 Ultra with 512GB of memory. Pedro Cuenca calls it a frontier model that runs on a desktop. The posts include commands and claims of running the model, but none reports throughput, latency, or output quality.
Written by AI from the articles below · updated Oct 15, 2:50 PM ET
Check the sources:
Developments
2 developments
- Oct 15, 2:36 PM ET · 1 articleMuse Spark Open GGUF quantized model runs locally via llama.cpp on MacMerve Noyan: Muse Spark Open 816B runs locally via llama.cpp on a Mac
- Oct 15, 1:55 PM ET · 1 articleClement Delangue shares a command to serve Muse-Spark-Open-816B GGUF locally on two Mac StudiosClément Delangue: Hugging Face's Clément Delangue shares llama serve command for Muse-Spark-Open GGUF
Article timeline
The articles in this story. Times are ET.
merve@mervenoyannXMuse Spark Open 816B runs locally via llama.cpp on a MacAIHugging Face's Merve Noyan shares a llama.cpp command serving the Muse-Spark-Open-816B-A42B GGUF Q2_K quantization, and says it pairs well with the pi.dev agent. Pedro Cuenca says the model runs on a Mac M3 Ultra with 512GB of memory, which he calls a frontier model on a desktop.
clem 🤗@ClementDelangueXHugging Face's Clément Delangue shares llama serve command for Muse-Spark-Open GGUFAIClément Delangue posts a llama serve command that runs ggml-org/Muse-Spark-Open-816B-A42B-GGUF at Q2_K quantization on two Mac Studios. He credits @finkd and @johnternus for the setup.

Heat trend
Not enough continuous observations to show a trend yet.