Dwarkesh Patel benchmarks AI models playing Blood on the Clocktower social deception

AIDwarkesh Patel spent $20,000 in API credits having AI models play each other at Blood on the Clocktower, a social deception game. He says the models improved over the year at improvised bluffing and team reasoning to expose conspiracies, and that OpenAI's newer models outperform Anthropic's at the game.

Dwarkesh Patel

@dwarkesh_sp

View on X

I spent 20,000 dollars in API credits having different AI models play each other at Blood on the Clocktower (a Mafia or Werewolf type social deception game).

The results were fascinating. Models have gotten much better over the course of this year at creative on-the-spot scheming and bluffing, and also at reasoning as a team to break apart these underground conspiracies.

I go through some of the most standout games these AIs played in this video. The new models are getting pretty good. If my friends pulled off some of these moves while we were playing, I’d give them a fist bump.

Fwiw, OpenAI’s newer models are much better than Anthropic’s at this game.

You can see the full benchmark at the website, and I’ve also made it so that you and your friends can play again the AIs: http://clocktowerbench.com

Source details

Dwarkesh Patel · x.comPublished Nov 5, 4:06 PM ET · added here 4:20 PM ET

Original title: I spent 20,000 dollars in API credits having different AI models play each other at Blood on the Clocktower (a Mafia or Werewolf type soc...

Dwarkesh Patel benchmarks AI models playing Blood on the Clocktower social deception

Topics