TL;DR:
- Open-weights MoE coding model: 40B total, 2.5B active, Apache 2.0
- Built from scratch in under 4 months mostly by their automated research system, the Eureka Machine
- Main tricks: a sparser shape, the output layer quantized to 4 bits, and custom kernels, including a fused decode kernel on M4 and M5 Macs
- Beats MoE peers like Qwen3.6 35B-A3B on agentic coding: Terminal-Bench 2.1 54.9 vs 44.9, SWE-bench Verified 74.2 vs 73.4
- Dense Qwen3.8 27B still wins on coding, with Terminal-Bench 73.0 vs 54.9
- 125+ tok/s on an M4 Pro MacBook and 150+ on a 64GB RTX Spark at short context; about 69 tok/s on average across a 128K session
