Skip to content
Trending storyDeveloping

Muse-Spark-Open 816B GGUF runs locally via llama.cpp on Mac hardware

2 articles2 sourcessince Oct 15Last article 1h ago ·

Overview

AISummary of 2 articles

Hugging Face CEO Clément Delangue posted a llama serve command that runs the ggml-org/Muse-Spark-Open-816B-A42B-GGUF model at Q2_K quantization on two Mac Studios, crediting @finkd and @johnternus for the setup.

Hugging Face's Merve Noyan later shared a llama.cpp command for the same Q2_K GGUF, saying it pairs well with the pi.dev agent and showing a demo running on a Mac M3 Ultra with 512GB of memory. Pedro Cuenca calls it a frontier model that runs on a desktop. The posts include commands and claims of running the model, but none reports throughput, latency, or output quality.

Written by AI from the articles below · updated Oct 15, 2:50 PM ET

Check the sources:

Developments

2 developments

  1. Oct 15, 2:36 PM ET · 1 article
    Muse Spark Open GGUF quantized model runs locally via llama.cpp on Mac
    Merve Noyan: Muse Spark Open 816B runs locally via llama.cpp on a Mac
  2. Oct 15, 1:55 PM ET · 1 article
    Clement Delangue shares a command to serve Muse-Spark-Open-816B GGUF locally on two Mac Studios
    Clément Delangue: Hugging Face's Clément Delangue shares llama serve command for Muse-Spark-Open GGUF

Article timeline

The articles in this story. Times are ET.

Oct 15
  1. merveX
    Muse Spark Open 816B runs locally via llama.cpp on a Mac

    AIHugging Face's Merve Noyan shares a llama.cpp command serving the Muse-Spark-Open-816B-A42B GGUF Q2_K quantization, and says it pairs well with the pi.dev agent. Pedro Cuenca says the model runs on a Mac M3 Ultra with 512GB of memory, which he calls a frontier model on a desktop.

  2. clem 🤗X
    Hugging Face's Clément Delangue shares llama serve command for Muse-Spark-Open GGUF

    AIClément Delangue posts a llama serve command that runs ggml-org/Muse-Spark-Open-816B-A42B-GGUF at Q2_K quantization on two Mac Studios. He credits @finkd and @johnternus for the setup.

    Video from @ClementDelangue's post

Heat trend

Not enough continuous observations to show a trend yet.