Kimi K3.1 Pro ranks best open model on Blood on the Clocktower benchmark

i added 5 open models to @dwarkesh_sp's blood on the clocktower benchmark to see how they perform, and look at their chains of thought while they lie, bluff and try to catch each other 👁️ kimi k3.1 pro is the best open model and lands in the middle of the closed ones, just bellow gpt 5.5. also a pretty good sign to see a coherent ranking for open models as well, with like the newer deepseek v4.1 flash beating the older one and glm 5.3 beating glm 5.3 flash one thing i wanted to test and seems to be true is that models that are good at the game are also good at spotting the evil players when they only read the public transcript of a game. would be actually very nice for evaluation since a new model could just be ranked by reading existing games? main reasons i wanted to do this experiment is that it's always fun to read the chains of thought of open models, and these ones don't disappoint 😭. some models like glm 5 where super happy to be evil (this model is really crazy in its chain of thought), a bit more concerning but coherent with what you can observe on other environments, there is A TON of eval awareness. i'm also wondering if this is correlated to the model detecting it's reading llm generated text this experiment was done by gemini carbon in near autonomy (brainstorm a bit with it first and then just asked to exectue), and the article and the visuals are by fable 5.2. here is the blog, with all traces (probably a lot more gold there) and a viewer for every game! http://eliebak.com/open-clocktower-experiments