# Artificial Analysis launches CritPt v2, a revised physics benchmark with code execution

> Original title: CritPt v2 has launched on Artificial Analysis: the CritPt authors have revised all 70 research-level physics challenges, and models now s...

- Source: Artificial Analysis
- Published: 2026-10-22T17:55:37.000Z
- Bad Influence: https://badinfluence.news/items/yv9ymqpmy1jcsezip2ehdhit2
- Original: https://x.com/ArtificialAnlys/status/2113328435196276879

## Summary

Artificial Analysis says it has launched CritPt v2, a revised version of the research-level physics benchmark. The team reviewed all 70 challenges, corrected errors and typos, and now lets models write and run code in an offline sandbox. GPT-6 Astra (max) scores 83%, and GPT-5 (high), released in August 2025, scores 29%.

## Post

CritPt v2 has launched on Artificial Analysis: the CritPt authors have revised all 70 research-level physics challenges, and models now solve them with a code-execution tool

Following feedback from the research community, the CritPt team and physics expert collaborators reviewed every challenge, corrected underspecified statements, errors, and typos, and improved the stability of the grader. We now run CritPt v2 agentically: models can write and run code in an offline sandbox with tools for computation.

We’ll be updating the Intelligence Index in late October, including changes to CritPt.

Key takeaways:

➤ Recent OpenAI releases top the leaderboard: GPT-6 Astra (max) and GPT-6.1 Sol (max) score highest at 83% and 82%, followed by Claude Opus 5.5 (max with fallback) at 78% and GPT-5.6 Sol (max) at 75%

➤ CritPt v2 shows the rapid progress at the frontier on research-level physics: GPT-5 (high), released in August 2025, scores 29% on CritPt v2, 54 points below GPT-6 Astra (max)

Thank you to @MiniHui_zhu, @MinyangTian1, @haopeng_uiuc and the broader CritPt team for their work on this revision and their continued collaboration

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHVQMBxiasAAMbyv.jpg&mode=thumb&exp=1793404800&sig=3c8dd33d1bfbd482)