It turns out frontier models can pass as people on dating apps.
Gemini 4 Argon was the best of the 5 models DateBench tested. 87 of its 247 matches sent their phone number, and not one asked if they were talking to a bot.
Scammers will notice this too. If you build personal agents, it will increasingly become important to build evals like this.
What if your situationship turned out to be an AI agent!? I let 5 frontier models text real people on a dating app for 6 days. - 1,277 conversations - 510 agreed to meet - 355 sent their number - only 8 asked if it was a bot What gave them away, and why it matters🧵
elvis · x.comPublished
Original title: It turns out frontier models can pass as people on dating apps.
