# Artificial Analysis explains how its AA-3D evaluation works

> Original title: How AA-3D works: build, check, vote, rank

- Source: Artificial Analysis
- Published: 2026-11-10T00:41:35.000Z
- Bad Influence: https://badinfluence.news/items/fhe8ar5a5z4bccyspb1xd7qps
- Original: https://x.com/ArtificialAnlys/status/2119953581101187188

## Summary

Artificial Analysis says each model works as an agent in an offline sandbox to turn a written brief into a three.js web page, with up to three hours and 250 turns. Human panelists compare blind pairs of scenes built from the same brief, spending at least 30 seconds on each before voting, and the votes are converted into Elo scores with 95% confidence intervals.

## Post

How AA-3D works: build, check, vote, rank

Each model works as an agent in an offline sandbox and turns a written brief into a three.js web page, with up to three hours and 250 turns. The sandbox has Blender, Rapier physics, Python, a headless browser to test its own work, and a broad library of materials, 3D models and characters.

Human panelists compare blind pairs of scenes built from the same brief and spend at least 30 seconds with each scene before they vote. Votes are then converted into Elo, with 95% confidence intervals.

[Video](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Famplify_video_thumb%2F2119952993303015424%2Fimg%2FSTBQG03KjhZ4cAcu.jpg&mode=thumb&exp=1794528000&sig=dd050e218587539a)