Skip to content
View original post on X: Santiago
Published
44/100

Flint, a 40B open-weight local coding model, runs at 125 tokens/sec on M4 MacBook Pro

AISantiago highlights Flint, an open-weight coding model that runs locally on regular computers. Flint is a 40B-parameter mixture-of-experts model that activates 2.5B parameters per generated token and has a 512K context window.
SantiagoVerified on X
@svpino
View on X

Here is an open-weight coding model you can run locally on your computer.

It's a 40B parameter model with a mixture-of-experts architecture. It activates 2.5B parameters per generated token. 512K context window.

This thing runs on regular computers! 125 tokens/sec on an M4 MacBook Pro.

Good alternative to closed models, but make sure you check their usage guidance to understand the trade-offs.

Richard Socher@RichardSocher
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine. • Best-in-class fast local coding • Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark • Built from scratch in under 4 months Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
View quoted post on X
Source details

Santiago · x.comPublished · added here

Original title: Here is an open-weight coding model you can run locally on your computer.