Design Arena finds AI judges favor text-heavy websites over human voters
Overview
Design Arena reports that AI judges prefer websites with more text than human voters do.
Across 1,700+ matchups, AI judges picked the site with 2.5x or more text 83% of the time, while human voters picked it 63% of the time. In a separate test of 400 site pairs, Design Arena says the AI judges chose the wordier site 66% of the time with real text, 64% with every letter replaced by "x", and 56% with the text hidden. Human raters chose the wordier site 54% of the time. Design Arena concludes that grading designs with an AI judge would push them toward busier screens than people prefer.
Written by AI from the articles below · updated Nov 1, 2:47 PM ET
Check the sources:
Developments
3 developments
- Nov 1, 2:31 PM ET · 1 articleDesign Arena reports AI judges favor text-heavy sites over human votersDesign Arena: AI judges favor longer text, picking it 83% of the time over humans' 63%
- Nov 1, 2:31 PM ET · 1 articleDesign Arena finds AI judges prefer wordier websites than humans doDesign Arena: AI judges favor busier designs than people do in 400-pair test
- Nov 1, 2:31 PM ET · 1 articleDesign Arena reports AI judges favor busy, text-heavy website designs over minimalist onesDesign Arena: AI judges favor busy websites over minimalist ones, study finds
Article timeline
The articles in this story. Times are ET.
DesignArena@DesignArenaOfficialAI judges favor busier designs than people do in 400-pair testAIDesign Arena ran the same test on 400 site pairs and found AI judges picked the wordier site 66% of the time with real words, 64% with placeholder x's, and 56% with text hidden. Human raters chose the wordier site 54% of the time. The post concludes that grading design with an AI judge would push designs toward busier screens than people prefer.

DesignArena@DesignArenaOfficialAI judges favor longer text, picking it 83% of the time over humans' 63%AIAcross 1,700+ matchups, AI judges chose the site with 2.5x or more text 83% of the time, while real voters chose it 63% of the time. The bigger the text gap, the stronger the preference, and all five judges showed it.

DesignArena@DesignArenaOfficialAI judges favor busy websites over minimalist ones, study findsAIDesign Arena reports that five AI judges picked a website with nearly four times as much text over a minimalist one for the same request. The judges still chose the busier site when every letter was swapped for "x," and they agreed with the human reviewer once the text was hidden.

Heat Trend
- Current comparable heat
- 5
- Peak comparable heat
- 10Nov 1, 3:00 PM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.