The visual interface could be limiting performance, but frontier models don’t seem severely hampered by it, given they win 90%+ of the time on the easiest difficulty. We think measuring how they play in human-like conditions is worth it regardless.
Epoch AI says visual interface may limit frontier model game performance
AISummary
Epoch AI says the visual interface could be limiting model performance in its game benchmark. Frontier models still win over 90% of games on the easiest difficulty, so the interface does not appear to severely hamper them. Epoch AI says measuring how models play under human-like conditions is worthwhile regardless.
Post on XView on X
Source: Epoch AI · x.comPublished · added here