Magnitude launches an open source inference engine that tunes kernels to local hardware

Magnitude is an open source inference engine for agents that compiles and tunes its kernels on the user's device before running a model.

The source claims up to 2x faster decoding than llama.cpp, citing 92% faster decode on Metal and 19% on CUDA, and says one click connects agents such as Pi, OpenCode, Codex, and Claude Code.

It supports macOS, Windows, and Linux, and the source states that prompts and models stay on the user's machine.