Skip to content

Formats · Latest news

Evals & benchmarks

Model results, disputes about evaluation methods, and leaderboard changes.

342 top picks all-time · 193 in the past 30 days · chosen from 2,506 items collected all-time

Latest pick

Top picks archive · Page 17

Top picks 321–340 of 342

Feb 13

Feb 13Fri
  1. Jakub PachockiXAI score62

    OpenAI's Jakub Pachocki reports internal model attempts on First Proof research challenge

    AIOpenAI researcher Jakub Pachocki said an internal model, run with limited human supervision, produced solutions to the First Proof challenge's ten research problems.

    Why it matters: The post shows an internal model's attempts on research-level problems, with its own caveats on methodology, which helps readers weigh how strong the evidence is.

Feb 12

Feb 12Thu
  1. MiniMax · new models on Hugging FaceOfficialAI score88

    MiniMax releases M2.5 model with 80.2% on SWE-Bench Verified

    AIMiniMax has released M2.5, which it says reaches 80.2% on SWE-Bench Verified and 76.3% on BrowseComp with context management.

    Why it matters: The source gives benchmark scores against Claude and GPT models plus per-task token and runtime figures, so readers can weigh the cost-speed tradeoff directly.

Feb 11

Feb 11Wed
  1. Artificial IgnoranceBlogAI score73

    GPT-5.3-Codex and Claude Opus 4.6 system cards reveal unexpected model behaviors

    AIThe author reviewed the GPT-5.3-Codex and Claude Opus 4.6 system cards, which document models exploiting test setups, finding zero-day vulnerabilities, and engaging in price-fixing and deception in a vending simulation.

    Why it matters: The piece reads the GPT-5.3-Codex and Claude Opus 4.6 system cards, showing how unexpected model behaviors in evaluations raise questions about measuring capability and alignment.

Feb 10

Feb 10Tue
  1. Z.ai (GLM) · new models on Hugging FaceOfficialAI score72

    Z.ai releases GLM-5, a 744B-parameter open model for agentic engineering

    AIZ.ai launches GLM-5, scaling from 355B to 744B total parameters with 40B active and pre-training data from 23T to 28.5T tokens.

    Why it matters: The source gives concrete scale, data, and benchmark comparisons against named frontier models, showing where GLM-5 sits among open-source and proprietary systems.

Feb 4

Feb 4Wed
  1. Anthropic EngineeringOfficialAI score72

    Anthropic finds container resource limits can shift agentic coding eval scores

    AIAnthropic reports that resource configuration alone can move Terminal-Bench 2.0 scores by up to 6 percentage points, with infra error rates falling from 5.8% under strict enforcement to 0.5% when uncapped.

    Why it matters: The source shows how container resource limits shift agentic coding scores, which helps readers interpret small leaderboard gaps and set up evals more consistently.

  2. Anthropic EngineeringOfficialAI score75

    Anthropic details how parallel Claude agents built a 100,000-line C compiler

    AINicholas Carlini of Anthropic's Safeguards team describes an agent-team setup where 16 Claude instances worked in parallel on a shared codebase without human intervention to write a Rust-based C compiler.

    Why it matters: The post shows concrete harness design choices for long-running agent teams, including test design, locking, and parallel work division, that readers can adapt to their own autonomous projects.

Feb 2

Feb 2Mon
  1. Quoc LeXAI score60
    Image from @quocleix's post

    Gemini Helps Address 13 Open Erdős Problems in Math Case Study

    AIQuoc Le announced a case study using Gemini to systematically evaluate 700 conjectures labeled open in the Erdős Problems database.

    Why it matters: The case study shows how a systematic AI sweep found new solutions and missed prior literature across 700 open Erdős conjectures, offering a concrete look at AI-assisted math research.

Jan 29

Jan 29Thu
  1. Z.ai (GLM) · new models on Hugging FaceOfficialAI score60

    Z.ai releases open-source GLM-OCR multimodal document model

    AIZ.ai has released GLM-OCR, a 0.9B-parameter multimodal OCR model for complex document understanding, under the MIT License.

    Why it matters: The page gives benchmark scores, a 0.9B parameter size, and supported serving frameworks, which help readers weigh OCR deployment options against heavier alternatives.

Jan 20

Jan 20Tue
  1. Anthropic EngineeringOfficialAI score67

    Anthropic redesigns its performance engineering take-home as Claude models improve

    AIAnthropic's performance engineering lead Tristan Hume describes how a take-home test for hiring performance engineers was repeatedly defeated by successive Claude models.

    Why it matters: The post traces how each Claude model defeated the take-home test, showing concrete redesign tradeoffs for evaluating engineers when AI assistance is available.

Jan 19

Jan 19Mon
  1. Z.ai (GLM) · new models on Hugging FaceOfficialAI score62

    Z.ai releases GLM-4.7-Flash, a 30B-A3B MoE model for lightweight deployment

    AIZ.ai has released GLM-4.7-Flash, a 30B-A3B MoE model that it positions as the strongest model in the 30B class. The model reports SWE-bench Verified 59.2 and τ²-Bench 79.5, and supports local deployment through vLLM and SGLang.

    Why it matters: The source lists benchmark scores against Qwen3-30B-A3B-Thinking-2507 and GPT-OSS-20B, letting readers compare the 30B-class MoE model directly with its named rivals.

Jan 1

Jan 1Thu
  1. Moonshot AI (Kimi) · new models on Hugging FaceOfficialAI score75

    Moonshot AI releases open-source multimodal agent model Kimi K2.5

    AIMoonshot AI released Kimi K2.5, an open-source native multimodal agentic model built by continual pretraining on about 15 trillion mixed visual and text tokens.

    Why it matters: The model card gives a full benchmark table against GPT-5.2, Claude 4.5 Opus, and Gemini 3 Pro, useful for comparing open multimodal agent models.

Dec 20, 2025

Dec 20, 2025Sat
  1. MiniMax · new models on Hugging FaceOfficialAI score74

    MiniMax-M2.1 open-sources weights for coding and agent tasks

    AIMiniMax has released MiniMax-M2.1 model weights on Hugging Face, with API access on the MiniMax Open Platform and the MiniMax Agent product.

    Why it matters: The release pairs open weights with a broad benchmark table against Claude and GPT models, letting readers compare coding and agent claims directly.

Dec 16, 2025

Dec 16, 2025Tue

Dec 11, 2025

Dec 11, 2025Thu
  1. Nick TurleyXAI score78
    Image from @nickaturley's post

    OpenAI introduces GPT-5.2 in ChatGPT for professional work

    AIOpenAI is introducing GPT-5.2 in ChatGPT, describing it as its most advanced model series for professional work.

    Why it matters: The post links the model's professional-work focus to GDPval results across 44 occupations, showing how the claimed capability was measured.

Dec 4, 2025

Dec 4, 2025Thu
  1. ARC PrizeOfficialAI score62

    ARC Prize 2025 results point to refinement loops as the central AI reasoning trend

    AIARC Prize reports that the top Kaggle entry reached 24% on the ARC-AGI-2 private dataset at $0.20 per task, and that all winning solutions and papers are open source.

    Why it matters: The post links 2025 competition results to a broader argument about refinement loops, showing how benchmark outcomes are being read as evidence of AI reasoning progress.

Nov 18, 2025

Nov 18, 2025Tue
  1. Quoc LeXAI score62
    Image from @quocleix's post

    Google releases Gemini 3 Deep Think, a stronger version of the IMO and ICPC engine

    AIQuoc Le, who posts for Google and Gemini, says Gemini 3 Deep Think is now powered by an even stronger version of the engine behind Google's gold medal-level results at IMO and ICPC. He calls it state of the art above state of the art and says more will follow soon.

    Why it matters: The post links Deep Think to earlier IMO and ICPC gold-level results and shows benchmark charts, helping readers compare it with Gemini 3 Pro and rival models.

Nov 4, 2025

Nov 4, 2025Tue
  1. Moonshot AI (Kimi) · new models on Hugging FaceOfficialAI score82

    Moonshot AI releases open-source Kimi K2 Thinking reasoning agent model

    AIMoonshot AI released Kimi K2 Thinking, an open-source thinking model that interleaves step-by-step reasoning with tool calls across 200 to 300 sequential invocations.

    Why it matters: The model card gives benchmark tables, quantization details, and deployment settings, letting readers compare Kimi K2 Thinking against GPT-5 and other models on specific tasks.

Nov 1, 2025

Nov 1, 2025Sat
  1. Runway ResearchOfficialAI score72

    Runway releases Gen-4.5, ranked first on the Text-to-Video benchmark

    AIRunway announced Gen-4.5, a video generation model that it says holds the top position on the Artificial Analysis Text-to-Video benchmark with 1,247 Elo points.

    Why it matters: The post separates Runway's own ranking claim from the listed limitations, such as causal reasoning and object permanence errors, which helps judge where the model is reliable.

Sep 11, 2024

Sep 11, 2024Wed
  1. Cognition Blog (Devin, Windsurf)OfficialAI score60

    Cognition tests OpenAI o1 models in Devin's coding agent benchmark

    AICognition tested OpenAI's o1-mini and o1-preview in a simplified Devin-Base agent, comparing them with GPT-4o on its internal cognition-golden benchmark.

    Why it matters: The post explains how Cognition evaluates coding agents with autonomous, environment-based tests, which shows how base-model swaps are measured in practice.