Skip to content
Trending storyDeveloping

Artificial Analysis finds US and UK English accent gaps in TTS and speech models

3 articles1 sourcesince Nov 6Last article 1h ago ·

Overview

AISummary of 3 articles

Artificial Analysis reports that 12 of 49 models show statistically significant performance differences between US and UK English, with non-overlapping confidence intervals.

Seven models perform better in US English and five favor UK English, and the average gap across all models is 7 Elo points.

In its TTS comparison, Lightning V3.1 Pro scores 94 Elo points higher in US English than in UK English, the largest gap among the models listed. Qwen-Audio-3.1-TTS-Plus scores 66 points higher in US English, while Soniox TTS Real-Time v2 and Speech 2.8 Turbo score 51 and 49 points higher in UK English. The firm says TTS models should be judged in the accent relevant to the use case rather than by overall rankings alone.

Artificial Analysis says its Controlled Voice Arena uses the same eight cloned voices for every model, four US English and four UK English, with separate leaderboards for each accent.

Written by AI from the articles below · updated Nov 6, 8:16 PM ET

Check the sources:

Developments

3 developments

  1. Nov 6, 8:01 PM ET · 1 article
    Artificial Analysis explains its Controlled Voice Arena evaluation
    Artificial Analysis: Artificial Analysis compares TTS models on the same 8 cloned voices
  2. Nov 6, 8:01 PM ET · 1 article
    Artificial Analysis compares TTS model performance across US and UK English
    Artificial Analysis: Artificial Analysis finds the largest TTS gaps between US and UK English accents
  3. Nov 6, 8:01 PM ET · 1 article
    Artificial Analysis reports model performance differences across English accents
    Artificial Analysis: Artificial Analysis finds US vs UK English accent gaps in 12 of 49 models

Article timeline

The articles in this story. Times are ET.

Nov 6
  1. Artificial AnalysisOfficial
    Artificial Analysis finds the largest TTS gaps between US and UK English accents

    AIArtificial Analysis reports that Lightning V3.1 Pro scores 94 Elo points higher in US English than in UK English, the largest gap among the models it lists. Qwen-Audio-3.1-TTS-Plus scores 66 points higher in US English, while Soniox TTS Real-Time v2 and Speech 2.8 Turbo score 51 and 49 points higher in UK English. The firm says TTS models should be evaluated in the accent relevant to the use case rather than judged by overall rankings alone.

    Image from @ArtificialAnlys's post
  2. Artificial AnalysisOfficial
    Artificial Analysis compares TTS models on the same 8 cloned voices

    AIArtificial Analysis says its Controlled Voice Arena evaluates every model with the same eight cloned voices, four US English and four UK English. Listeners can compare speech quality across models on separate US and UK English leaderboards.

  3. Artificial AnalysisOfficial
    Artificial Analysis finds US vs UK English accent gaps in 12 of 49 models

    AIArtificial Analysis reports that 12 of 49 models show statistically significant performance differences between US and UK English, with non-overlapping confidence intervals. Seven models perform better in US English and five favor UK English. The average gap across all models is 7 Elo points.

    Image from @ArtificialAnlys's post

Heat Trend

Not enough continuous observations to show a trend yet.