Skip to content
Trending storyDeveloping

Design Arena finds AI judges favor text-heavy websites over human voters

3 articles1 sourcesince Nov 1Last article

Overview

AISummary of 3 articles

Design Arena reports that AI judges prefer websites with more text than human voters do.

Across 1,700+ matchups, AI judges picked the site with 2.5x or more text 83% of the time, while human voters picked it 63% of the time. In a separate test of 400 site pairs, Design Arena says the AI judges chose the wordier site 66% of the time with real text, 64% with every letter replaced by "x", and 56% with the text hidden. Human raters chose the wordier site 54% of the time. Design Arena concludes that grading designs with an AI judge would push them toward busier screens than people prefer.

Written by AI from the articles below · updated Nov 1, 2:47 PM ET

Check the sources:

Developments

3 developments

  1. Nov 1, 2:31 PM ET · 1 article
    Design Arena reports AI judges favor text-heavy sites over human voters
    Design Arena: AI judges favor longer text, picking it 83% of the time over humans' 63%
  2. Nov 1, 2:31 PM ET · 1 article
    Design Arena finds AI judges prefer wordier websites than humans do
    Design Arena: AI judges favor busier designs than people do in 400-pair test
  3. Nov 1, 2:31 PM ET · 1 article
    Design Arena reports AI judges favor busy, text-heavy website designs over minimalist ones
    Design Arena: AI judges favor busy websites over minimalist ones, study finds

Article timeline

The articles in this story. Times are ET.

Nov 1
  1. DesignArenaOfficial
    AI judges favor busier designs than people do in 400-pair test

    AIDesign Arena ran the same test on 400 site pairs and found AI judges picked the wordier site 66% of the time with real words, 64% with placeholder x's, and 56% with text hidden. Human raters chose the wordier site 54% of the time. The post concludes that grading design with an AI judge would push designs toward busier screens than people prefer.

    Video from @DesignArena's post
  2. DesignArenaOfficial
    AI judges favor longer text, picking it 83% of the time over humans' 63%

    AIAcross 1,700+ matchups, AI judges chose the site with 2.5x or more text 83% of the time, while real voters chose it 63% of the time. The bigger the text gap, the stronger the preference, and all five judges showed it.

    Video from @DesignArena's post
  3. DesignArenaOfficial
    AI judges favor busy websites over minimalist ones, study finds

    AIDesign Arena reports that five AI judges picked a website with nearly four times as much text over a minimalist one for the same request. The judges still chose the busier site when every letter was swapped for "x," and they agreed with the human reviewer once the text was hidden.

    Video from @DesignArena's post

Heat Trend

Current comparable heat
5
Peak comparable heat
10Nov 1, 3:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.