Arena ranks Inkling 2 Small at 1654 points in Code Arena WebDev

AIArena says Thinking Machines' Inkling 2 Small scored 1654 points in Code Arena WebDev with AutoEval, ranking #20 overall and #4 among open models. The model is priced at $1.00 per 1M output tokens and $0.30 per 1M input tokens, and Arena says it would rank #1 among US open models once its weights are released.

Arena.aiOfficial

@arena

View on X

Exciting news: Inkling 2 Small by @thinkymachines has landed in Code Arena: WebDev with 1654 pts (AutoEval). Once its weights are released, it would rank #1 among US open models!

This is +128 pts ahead of Meta’s Muse Spark Open at #2 (US open).

Inkling 2 Small would rank #4 among open models globally, and ranks #20 overall. This is +245 pt improvement over its previous variant, Inkling Small (#32 open with 1409 pts).

This model is priced at $1.00/1M output and $0.30/1M input. More info coming soon on its median cost per task in the Code Arena: WebDev, and results in the Agent Arena.

Congrats to the team at @thinkymachines on this release!

Thinking Machines@thinkymachines

Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. https://thinkingmachines.ai/news/inkling-2-small

View quoted post on X

Source details

Arena.ai · x.comPublished Nov 5, 6:55 PM ET

Original title: Exciting news: Inkling 2 Small by @thinkymachines has landed in Code Arena: WebDev with 1654 pts (AutoEval). Once its weights are release...

Arena ranks Inkling 2 Small at 1654 points in Code Arena WebDev

Topics