Exciting news: @AIatMeta's Muse Ember (Max) is the highest-performing small model in the Code Arena: WebDev with 1608 pts, outperforming two leading small models from Anthropic and OpenAI:
- Claude Haiku 5.5 (High): #35, 1595 pts
- GPT-6 Luna (Max): #42, 1578 pts
At a 1608 score at a median cost of $0.03 per task, this puts Ember on the Pareto frontier. Neither Haiku 5.5 nor Luna makes it. Despite all three models having the same API pricing of $0.10/$0.50 per million input/output tokens, Ember's median cost per task is 2× lower than Luna ($0.06) and 3.7× lower than Haiku ($0.11).
In our own testing, Ember demonstrated impressive speed and efficiency, completing 25 complex generations in 2 mins per task, at a total cost of just $1.
Huge congrats to @alexandr_wang and the @AIatMeta team on this impressive release! A major step forward for small models that deliver strong real-world coding capabilities at a fraction of the cost.