# Voice Arena's Turing TTS benchmark: best model fools listeners 10% of the time

> Original title: Voice AI is now good enough that preference and human-likeness can be scored as separate targets.

- Source: Rohan Paul
- Published: 2026-10-30T19:06:17.000Z
- Bad Influence: https://badinfluence.news/items/g6w0hf8b989xtyoicmypivzyo
- Original: https://x.com/rohanpaul_ai/status/2116245323039592529

## Summary

Voice Arena launches Turing TTS, a benchmark where listeners hear a human and a model say the same sentence and pick the human. Gemini 3.8 Flash TTS, the top model, fooled listeners 10% of the time, and the top four models on its preference board are statistically tied.

## Post

Voice AI is now good enough that preference and human-likeness can be scored as separate targets.

@voicearena_ai launched a new benchmark, Turing TTS to score the second one directly: listeners hear the same sentence from a person and from a model, then pick the person.

How often they pick the model is the Fool Rate. 50% would mean listeners can’t tell.

Even the best model, Gemini 3.8 Flash TTS, fooled them about 10% of the time.

On Voice Arena’s preference board, the top four models are statistically tied. Measured against a human, the whole field still has a long way to go.

https://x.com/shobhitbanga/status/2116236578045702373/video/1

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHV5pzc2agAARPZW.jpg&mode=thumb&exp=1793577600&sig=6dd703d8deba7334)

[Video](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Famplify_video_thumb%2F2116231032974520321%2Fimg%2FKJWOMuYI97R5O8yu.jpg&mode=thumb&exp=1793577600&sig=112580d3986150aa)

## Quoted post @shobhitbanga

> Drop 2/15 
> 
> Are we actually measuring the things we ultimately want our voice AI models to achieve?
> 
> The best AI voices are becoming hard to tell apart.
> From each other. Not from humans.
> 
> 🚀 Introducing Turing TTS: an evaluation that measures how often human listeners mistake AI-generated speech for real human speech.
> 
> We tested leading TTS models against real human speech. Even the best model fooled listeners only ~10% of the time.
> 
> With Turing TTS, we hope to contribute to a broader discussion within the research community about how we measure progress in voice AI.
> 
> If one of our goals is to develop speech that is indistinguishable from human speech, how well do our current evaluation methods capture progress toward that goal?
> 
> We don’t claim that Turing TTS is the right way forward, or that human indistinguishability should be the goal of every TTS system.
> 
> Rather, we hope these findings encourage the community to collectively examine whether blind pairwise human evaluations of naturalness are sufficient, and what else we might need to measure.
> 
> Results are now live on @voicearena_ai.

https://x.com/shobhitbanga/status/2116236563147591818