KR — ZDNet Korea
Nvidia Releases Open Speech Recognition Model That Transcribes 40 Languages
AI1 min read
Nvidia released Nemotron 3.5 Transcribe, a free-to-download AI model that turns speech into text in 40 languages. It is an open-weight model, so anyone can download and run it.
What happened
On October 28 (local time), Nvidia released an open-weight speech-to-text AI model called Nemotron 3.5 Transcribe. It can transcribe speech in 40 languages and translate speech between English and most of the other supported languages. It works on recordings, not on live speech. It can handle up to one hour of audio at a time and label who is speaking.
Key numbers and facts
- Total size: about 34 billion parameters (the settings a model learns), but only about 4.3 billion are used for each task.
- Speaker labels: up to 8 speakers, according to TechCrunch.
- Word error rate (lower is better): 4.71% on average across 9 English open ASR datasets, and 4.62% across 7 other languages.
- Multi-speaker meeting test: 15.80%, better than the previous best public score of 16.83%.
- Speed: about 2,238 seconds of audio processed per second on one RTX PRO 6000 GPU, according to Nvidia.
Background
Nvidia uses a design called a mixture of experts (MoE). This means that for each job, only some specialist parts of the model turn on. That keeps the work needed low, even though the full model is large. Nvidia also released Granary v2, a speech dataset that companies can use to teach the model specialized industry terms.
Why it matters
Speech-to-text tools are used for meeting notes and medical records. Because this model is open and free to use commercially, companies can run it on their own computers. The market is also getting crowded: earlier this month Mistral released a transcription model called Voxtral 3, and ElevenLabs launched a real-time model for voice agents.
What to watch
- Whether independent tests confirm Nvidia's accuracy scores.
- How well the model works in real meetings and medical settings.
- How other companies respond with new speech models.
Glossary
- Nvidia
- A US company that makes chips and AI tools, including the GPUs used to run AI models.
- Word error rate
- The share of words in a transcript that are wrong. Lower numbers mean more accurate results.
- Granary
- A speech dataset Nvidia released that can be used to train the model on industry-specific terms.