Skip to content
Trending storyDeveloping

Jason Wei charts which benchmarks frontier labs reported in 2026

1 article1 sourcesince Nov 10Last article

Overview

AISummary of 1 article

Jason Wei created a frequency distribution of the benchmarks that frontier labs reported in 2026, shared on X. He says HLE, SWE-Bench Pro, DeepSWE, and Terminal-Bench were adopted by every lab.

He also says OpenAI reported the most benchmarks, while Anthropic's only entry, BioMysteryBench, is rarely used by others.

Written by AI from the articles below · updated Nov 10, 5:50 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 10
  1. Jason WeiX
    Jason Wei charts which benchmarks frontier labs reported in 2026

    AIJason Wei created a frequency distribution of the benchmarks that frontier labs reported in 2026. He says HLE, SWE-Bench Pro, DeepSWE, and Terminal-Bench saw universal adoption, and that OpenAI produced the most benchmarks while Anthropic's only entry, BioMysteryBench, is rarely used.

    Image from @_jasonwei's post

Heat Trend

Current comparable heat
7
Peak comparable heat
10Nov 10, 6:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.