Voice Agents do more than understand what you say. They decide what to do next.
Introducing DECIDE, a benchmark for evaluating those decisions on real production calls.
Tazo Labs introduces DECIDE, a benchmark for voice agent decisions
AITazo Labs introduces DECIDE, a benchmark that evaluates voice agents on the decisions they make during real production calls, such as when to speak, route a call, pick a tool, or switch language. DECIDE contains 4,867 decision questions drawn from 1,081 real agent-caller clips of 3 to 25 seconds, across 32 tasks in six families.
bolnaVerified on X
@bolna_dev
Introducing DECIDE: a benchmark for audio decisions in voice agents, in association with @bolna_dev A voice agent doesn’t just transcribe. It decides: speak or wait, route the call, pick a tool, switch language. Text can’t tell you if the caller sounded annoyed, interrupted, or talked over the agent. DECIDE tests exactly that, on real production calls. → 4,867 decision questions from 1,081 real agent-caller clips (3 to 25 seconds) → 32 tasks across 6 families: turn-taking, graph routing, tool decisions, language switching, caller emotion, business intent Direct-audio models and STT + text models (20 in total) are scored on the same questions, so you can see what audio actually adds, and what it costs in dollars and milliseconds. Submit your model endpoint and get scored; no invite needed. Website: https://benchmark.tazolabs.com/ Samples: https://huggingface.co/datasets/tazolabs/DECIDE-samples
Source details
bolna · x.comPublished · added here
Original title: Voice Agents do more than understand what you say. They decide what to do next.