NVIDIA NemotronLabs VoiceChat 11B (and PersonaPlex-7B)
English only. Requires datacenter GPU (A100/H100/H200/B100/B200 or RTX 6000). 'First' is NVIDIA's claim on the model card. HF card release date 2026-08-03; arXiv paper 2609.21967 (Sept 2026).
- Input
- audio
- Output
- audio, text
- License
- OpenMDW-1.1
- Verified
- 2026-09-29
How to call it
| Provider | Model id | Endpoint / URL | Docs |
|---|---|---|---|
| Hugging Face | nvidia/NVIDIA-NemotronLabs-VoiceChat-11B | huggingface.co/nvidia/NVIDIA-NemotronLabs-VoiceChat-11B | — |
| Hugging Face | nvidia/personaplex-7b-v1 | huggingface.co/nvidia/personaplex-7b-v1 | — |
| arXiv | — | arxiv.org/abs/2609.21967 | — |
Notable capabilities (3)
- FIRST Open full-duplex speech model with tool calling: End-to-end (FastConformer encoder + Nemotron Nano v2 9B + TTS decoder, 11B total) full-duplex voice chat that calls tools mid-conversation; NVIDIA calls it the first open full-duplex model to support tool calling. BFCL-v3 (AU Harness) 56.1%, Full-Duplex-Bench v3 tool selection 82.5%. source
- Natural turn-taking: ~450 ms turn-taking latency; #2 among open models on VoiceBench and Full-Duplex-Bench 1.0 (smooth turn-taking 0.82, interruption latency 480 ms). source
- PersonaPlex: persona + voice prompted full duplex (found after launch): PersonaPlex-7B-v1 (2026-01-15), fine-tuned from Kyutai Moshiko, takes a voice prompt and a text persona/role prompt. source
Sources: https://huggingface.co/nvidia/NVIDIA-NemotronLabs-VoiceChat-11B , https://huggingface.co/nvidia/personaplex-7b-v1
Timeline entry
- NVIDIA releases NemotronLabs VoiceChat 11B, an open full-duplex voice model with tool calling ★★★
NVIDIA published NVIDIA-NemotronLabs-VoiceChat-11B on Hugging Face (card dated 2026-08-03; arXiv 2609.21967): an end-to-end, full-duplex speech-to-speech model (FastConformer encoder + Nemotron Nano v2 9B + TTS decoder) that NVIDIA calls the first open full-duplex model to support tool calling. It…
Other NVIDIA models
NVIDIA Nemotron 3.5 Lightning (30B-A3B) · NVIDIA Nemotron 3 Ultra (550B-A55B) · Cosmos 3 (Nano / Super) · NVIDIA Nemotron 3 Nano Omni (30B-A3B Reasoning) · Isaac GR00T N1.7 · NVIDIA Nemotron 3 Super (120B-A12B) · Cosmos Reason 2 · NVIDIA MagpieTTS Multilingual 357M · NVIDIA Parakeet / Canary / Nemotron Speech ASR (open) · Isaac GR00T N2 · Cosmos Predict 2.5 / Transfer 2.5 · Isaac GR00T N1 / N1.5 / N1.6