Skip to content
Trending storyDeveloping

Nvidia releases open-weight Nemotron 3.5 Transcribe speech model and Granary v2 dataset

8 articles8 sourcessince Oct 28Last article 1h ago ·

Overview

AISummary of 8 articles

Nvidia releases Nemotron 3.5 Transcribe, a free open-weight speech model with 30 billion total parameters and about 4 billion active, along with the Granary v2 dataset.

Nvidia says the model transcribes audio in 40 languages, translates 31 languages to and from English, labels up to eight speakers in recordings, and runs on a single GPU. TechCrunch reports it works only with recorded audio, not live streams.

Reports conflict on the length limit. TechCrunch and ModelScope say recordings up to an hour, while SiliconANGLE says up to 100 hours. The Decoder reports Granary v2 contains about 844,000 hours of speech in 48 languages.

On accuracy, Nvidia cites a 30.8% word error rate out of the box, according to SiliconANGLE, with no independent evaluation. Artificial Analysis reports 2.8% on its AA-WER Index, tying Mistral's Voxtral Small for first among open-weight speech-to-text models. Voxtral Small has 24 billion active parameters, about six times as many.

Written by AI from the articles below · updated Oct 28, 12:03 PM ET

Check the sources:

Developments

3 developments

  1. Oct 28, 11:08 AM ET · 3 articles
    NVIDIA releases Nemotron 3.5 Transcribe, an open-weight 30B MoE speech model
    ModelScope: NVIDIA releases Nemotron 3.5 Transcribe, a 30B-A4B open-weight speech model
  2. Oct 28, 11:05 AM ET · 1 article
    Artificial Analysis ranks NVIDIA's Nemotron 3.5 Transcribe tied for #1 among open-weight Speech to Text models
    Artificial Analysis: NVIDIA's Nemotron 3.5 Transcribe ties for top open-weights speech-to-text accuracy
  3. Oct 28, 10:58 AM ET · 4 articles
    Nvidia releases open Nemotron 3.5 Transcribe audio model and Granary v2 dataset
    Hugging Face Blog: NVIDIA releases Nemotron 3.5 Transcribe, an open multilingual speech model with Granary v2 data

Article timeline

The articles in this story. Times are ET.

Oct 28
  1. The DecoderNews
    Nvidia releases open Nemotron 3.5 Transcribe for transcription, translation, and speaker recognition

    AINvidia has released Nemotron 3.5 Transcribe, an open speech model that takes text instructions and handles transcription, translation, and speaker recognition in one model. The company says it transcribes 40 languages, translates 31 to or from English, and identifies speakers in 13, with recordings up to an hour long. It also releases the Granary v2 dataset with about 844,000 hours of speech in 48 languages.

  2. vLLMOfficialPick
    NVIDIA releases Nemotron 3.5 Transcribe with day-0 vLLM serving

    AINVIDIA released Nemotron 3.5 Transcribe, an open-weight, promptable 30B MoE model with about 4B active parameters. It supports transcription in 40 languages, recordings up to an hour, speaker labels, and audio Q&A, with weights in BF16, FP8 and NVFP4, and serving through vLLM and NeMo Speech on day 0.

  3. NVIDIA AIOfficial
    NVIDIA releases Nemotron 3.5 Transcribe, an open-weight speech model

    AINVIDIA announces Nemotron 3.5 Transcribe, an open-weight, promptable 30B MoE model with about 4B active parameters. The model covers transcription in 40 languages, speaker attribution, translation, contextual prompting, and audio understanding in one checkpoint.

    Video from @NVIDIAAI's post
  4. ModelScopeOfficialPick
    NVIDIA releases Nemotron 3.5 Transcribe, a 30B-A4B open-weight speech model

    AIModelScope announces NVIDIA's Nemotron 3.5 Transcribe, a 30B-A4B open-weight model that transcribes up to an hour of speech with speaker labels, translations, and audio answers. The post says it transcribes 40 languages, translates 31 languages to and from English, and supports speaker attribution in 13 languages for recordings with up to eight speakers. It runs on a single GPU and is released under the openmdw-1.1 license.

    GIF from @ModelScope2022's post
  5. Artificial AnalysisOfficial
    NVIDIA's Nemotron 3.5 Transcribe ties for top open-weights speech-to-text accuracy

    AINVIDIA releases Nemotron 3.5 Transcribe, an open-weights non-streaming speech-to-text model with 30B total and 4B active parameters. It scores 2.8% on Artificial Analysis's AA-WER Index, tying Mistral's Voxtral Small for first among open-weights models, and 1.8% versus 2.3% on AA-AgentTalk, a voice agent conversation dataset. Voxtral Small has 24B active parameters, six times as many as Nemotron 3.5 Transcribe.

    Image from @ArtificialAnlys's post
  6. SiliconANGLE · AINews
    Nvidia releases open Nemotron 3.5 Transcribe model for audio transcription and translation

    AINvidia released Nemotron 3.5 Transcribe, an open-weight 30-billion-parameter mixture-of-experts model with 4 billion active parameters, for multilingual audio transcription and translation. It handles up to 100 hours of audio in 40 languages, labels up to eight speakers in a single pass, and reports 30.8% word error rate out of the box. Nvidia also released the Granary v2 dataset and a Hugging Face demo for fine-tuning.

  7. TechCrunch · AINews
    Nvidia releases open-weight Nemotron 3.5 Transcribe speech model

    AINvidia releases Nemotron 3.5 Transcribe, a free open-weight model that transcribes audio in up to 40 languages, and version 2 of its open-source Granary speech dataset. The 30-billion-parameter model handles recordings up to an hour long, translates 31 languages to and from English, and tells up to eight speakers apart. Nvidia says it runs on a single chip, from Jetson AGX Thor to Blackwell datacenter chips, but it works only with recorded audio, not live streams.

  8. Hugging Face BlogOfficialPick
    NVIDIA releases Nemotron 3.5 Transcribe, an open multilingual speech model with Granary v2 data

    AINVIDIA releases Nemotron 3.5 Transcribe, an open-weight model that transcribes 40 languages, translates 31 to or from English, and attributes speakers in 13. It also releases the Granary v2 data pipeline and fine-tuning recipes, and in a medical case study fine-tuning cut held-out word error rate by 45.8% relative to the best prompt.

Heat Trend

Not enough continuous observations to show a trend yet.