We’re about to see a breakout in local model capabilities.
Flint scores 54.9% on Terminal-Bench 2.1 with ~2B active parameters. That’s ahead of every other small MoE and two of the three dense ~30B models.
It only needs about 24GB and runs at 125+ tok/s on a MacBook Pro.