Janas-LLM streams experts from SSD to run 80B models on a 32 GB laptop

Janas-LLM, an open-source engine written in C, runs mixture-of-experts language models larger than RAM by streaming expert weights from an NVMe SSD. The author reports 37 tok/s writing from Qwen3-Next-80B, a 48.4 GB model, on a laptop with 32 GB of memory, where llama.cpp reached 2.8 tok/s.

The benchmarks come from one machine, with the author noting that other hardware will produce different figures.