Gradium TTS starts streaming audio in 155 ms median on Coval benchmark
Original titleDelivering real-time text-to-speech with Gradium
AISummary
Gradium's text-to-speech model reaches a median Time-to-First-Audio of 155 ms with a 2 ms interquartile range on the Coval TTS benchmark, captured May 4, 2026.
Its Delayed Streams Modeling design runs audio a few 80 ms steps behind incoming text, so speech can start before the LLM finishes its response.
Gradium cuts latency with kernel fusion and CUDA Graphs, which Gradium says reduced median TTFA by more than 2.5x at small batch sizes.
Source: Baseten Blog · baseten.coPublished · added here