Design Arena: K3.1 Pro games finish more often than K3 games
Article timeline
The articles in this story. Times are ET.
DesignArenaOfficialDesign Arena finds finishable games win about 83 rating points more in votesAIDesign Arena says that within each model's own games, a finishable game is worth about 83 rating points more in head-to-head votes than one that cannot be finished, with opponents held at their leaderboard ratings.
- DesignArenaOfficialAnd K3.1 Pro builds the whole game, not just the part users described.
AISeven in ten prompts never ask for a win, a level, a goal, or a mission. On those, 53% of K3.1 Pro's games can still be finished, against 28% of K3's. When the prompt does ask for an ending, it's 84% against 71%. It isn't down to who was prompting, either. Among the users who prompted both models, 73% of K3.1 Pro's games could be finished, against 30% of K3's.
- DesignArenaOfficialThat thinking shows up in the games.
AIDesign Arena says K3.1 Pro starts 94% of its games and completes 62% of them as playable, against 91% and 40% for K3. The post says the gap shows up in games that can be won or finished.
