We have measured intelligence. Now it's time to see it.
We are launching AA-3D, our new benchmark for how well AI models build interactive 3D scenes. Each model works as an agent in an offline sandbox and turns a written brief into a three.js web page. A human panel of judges compares pairs of scenes built from the same brief without knowing which model made which.
AA-3D details:
➤ 55 written briefs across seven domains, including landmarks, machines, living bodies, games, and space. Each brief says what the scene must show and how people should interact with it, and leaves the rest to the model
➤ Each model gets up to three hours and 250 turns. Its sandbox has Blender, Rapier physics, Python, a headless browser to test its own work, and a CC0 library of materials, 3D models, and characters
➤ Panelists spend at least 30 seconds with each scene before they vote. One comparison in every four is a validation check
➤ Over 10,000 counted votes from over 1,000 panelists rank 21 models by Elo, with 95% confidence intervals
Key findings:
➤ Four models are statistically tied at the top: Claude Sonnet 5.5 (1194), Claude Opus 5.5 (1190), GPT-6 Astra (1165), and Claude Fable 5.1 (1131). The 95% confidence intervals of the other three overlap Claude Sonnet 5.5's
➤ AA-3D Elo rises with intelligence: each point on the Artificial Analysis Intelligence Index is worth about 18 Elo (Pearson 0.92)
➤ The best-placed open weights models, Kimi K3 (982) and MiMo-V2.6-Pro (977), rank 11th and 12th, more than 200 points behind first place
➤ A scene costs $0.20 to $32.08, depending on the model. The cheapest, GPT-6 Luna, ranks eighth
More results, more scenes, and how AA-3D works follow in the thread below.