Skip to content
View original post on X: Artificial AnalysisOfficial
Published
Same story62/100

Artificial Analysis reports Inkling 2 Small's AA-Briefcase benchmark scores

AIArtificial Analysis says Inkling 2 Small scores 1527 Elo on AA-Briefcase, versus 912 for Inkling Small, 1439 for Claude Sonnet 5.5 (medium), and 1203 for Gemini 3.8 Flash (high). AA-Briefcase tests long-horizon business workflows that require spreadsheets, presentations, and memos.
Artificial AnalysisVerified on XOfficial
@ArtificialAnlys
View on X

Part of a thread · earlier post

Inkling 2 Small scores 615 Elo points higher than Inkling Small on AA-Briefcase, with 2.5x the rubric pass rate.

AA-Briefcase tests long-horizon business workflows requiring spreadsheets, presentations, and memos. Inkling 2 Small scores 1527 Elo vs. 912 Elo for Inkling Small, 1439 Elo for Claude Sonnet 5.5 (medium), and 1203 Elo for Gemini 3.8 Flash (high).

It passes 50% of rubric checks vs. 20% for Inkling Small, with analytical quality at 1634 Elo and presentation at 1564 Elo.

This story is featured in top picks: “Artificial Analysis reports Inkling 2 Small scores 1527 Elo on AA-Briefcase”

Source details

Artificial Analysis · x.comPublished · added here

Original title: Inkling 2 Small scores 615 Elo points higher than Inkling Small on AA-Briefcase, with 2.5x the rubric pass rate.

Topics

Evals & benchmarks