# Voice Arena's Dictation Bench tests AI dictation apps by use case

> Original title: A dictation benchmark should help someone choose a tool, not require them to become a speech researcher first. The useful starting questi...

- Source: Elvis Saravia
- Published: 2026-11-11T16:35:12.000Z
- Bad Influence: https://badinfluence.news/items/gyuqiuer9zcpkwv8nds9c74km
- Original: https://x.com/omarsar0/status/2120555957025386975

## Summary

Voice Arena releases Dictation Bench, an open benchmark that tests real dictation apps on a Mac rather than their APIs. The test uses 761 recordings from 87 speakers, and five LLM judges assess whether each draft could be sent as-is. The post says Wispr Flow scored 79% and Apple scored 35%, and argues that users should pick tools based on the output quality their specific tasks need.

## Post

A dictation benchmark should help someone choose a tool, not require them to become a speech researcher first. The useful starting question is what they need the tool to write.

For a coding workflow, exact technical terms matter. For messages and emails, preserving the intended meaning through restarts and corrections matters. A product can produce fluent text and still fail the task if it changes the detail the user needed to communicate.

@voicearena_ai's Dictation Bench is organized around seven use-case categories rather than one generic passage. It also separates the frequency of drafts needing a correction from the total volume of character edits, and shows examples that make those differences understandable.

If I were choosing a tool, I would use that evidence to build a shortlist, then test it on my own speech. Latency, privacy, and workflow fit would still matter, but I would start with a clearer picture of output quality.

That is the practical significance of a thorough evaluation: it makes a real decision less dependent on a polished demo. The research matters because it helps answer a question people already need to resolve.

## Quoted post @shobhitbanga

> Drop 4/15: Announcing the Voice Arena Dictation Bench - the first open benchmark of AI dictation apps.
> 
> Not their APIs: the real apps. We played 761 recordings from 87 speakers into each of 10 apps on a Mac, then 5 LLM judges asked if each draft could be sent as-is.
> 
> Wispr Flow: 79%. Apple: 35% 🧵

https://x.com/shobhitbanga/status/2120527865947234622