Skip to content
Read the original: Baseten BlogOfficial· 36/100AI score36/100

Gradium TTS starts streaming audio in 155 ms median on Coval benchmark

Original titleDelivering real-time text-to-speech with Gradium

AISummary

Gradium's text-to-speech model reaches a median Time-to-First-Audio of 155 ms with a 2 ms interquartile range on the Coval TTS benchmark, captured May 4, 2026.

Its Delayed Streams Modeling design runs audio a few 80 ms steps behind incoming text, so speech can start before the LLM finishes its response.

Gradium cuts latency with kernel fusion and CUDA Graphs, which Gradium says reduced median TTFA by more than 2.5x at small batch sizes.

Read the original baseten.co

Source: Baseten Blog · baseten.coPublished · added here