VibeVoice-ASR Streaming 1.5B
VibeVoice-ASR Streaming 1.5B is a speech-to-text model (3B total) from Microsoft, released under the MIT license. The reviewed source lists 10 languages (10 explicitly enumerated in our record), and the model is designed for native streaming. It produces speaker-attributed transcripts natively. Among the common setups we test, it ranks highest for Japanese live transcription (#3 of 26 in the matcher).
Native streaming speaker-attributed ASR released in September 2026. The 1.5B-named variant reports 3B total parameters on Hugging Face and supports 10 listed languages plus customized hotwords. The model card advertises Who/What streaming output, not full timestamped When output.
Key facts
| Provider | Microsoft |
|---|---|
| Model family | VibeVoice-ASR |
| Parameters | 3B total |
| License | MIT · Permissive — license text ↗ |
| Language coverage | 10 listed languages · 10 enumerated in our record |
| Streaming | Native streaming architecture |
| Timestamps | Limited or runtime-dependent |
| Speaker diarization | Yes — native speaker-attributed output |
| Speech translation | No |
| Documented runtimes | microsoft/VibeVoice, vLLM streaming server — how to run it |
| Primary source | huggingface.co/microsoft/VibeVoice-ASR-Streaming-1.5B ↗ |
| Last reviewed |
Hardware and workload fit
These are Speech Model Match's conservative 1–5 editorial ratings, relative to the other 19 reviewed models. They come from model size, official memory guidance and documented runtimes — not from a universal benchmark. How the ratings work.
| Dimension | Rating | Scale |
|---|---|---|
| CPU-only fit | 1/5 | |
| Apple Silicon fit | 2/5 | |
| NVIDIA GPU fit | 4/5 | |
| Speed | 4/5 | |
| Accuracy (relative) | 4/5 | |
| Low memory use | 2/5 | |
| Long recordings | 4/5 | |
| Live / low latency | 5/5 | |
| Subtitle work | 3/5 | |
| Edge / low-power devices | 1/5 |
Where it is strong
- Native speaker-attributed transcription (diarization)
- Native streaming architecture for live, low-latency transcription
- NVIDIA GPU fit: rated 4/5
- Speed: rated 4/5
- Accuracy (relative): rated 4/5
- Long recordings: rated 4/5
- Live / low latency: rated 5/5
What to check first
- CPU-only fit: rated 1/5
- Apple Silicon fit: rated 2/5
- Low memory use: rated 2/5
- Edge / low-power devices: rated 1/5
- Timestamp support is limited or runtime-dependent — test it if you need subtitles
How it ranks in common setups
Ranks come from the same deterministic matcher that runs on the homepage, applied to all 26 reviewed models. They are decision guidance, not accuracy claims.
| Setup | Rank | Fit score | Top match |
|---|---|---|---|
| Long recordings on an 8–12 GB NVIDIA GPU, balanced | #15 of 26 | 68/100 · Possible fit | Whisper turbo |
| Live captions or voice input (native streaming + timestamps, speed first) | #5 of 26 | 83/100 · Strong fit | Nemotron 3.5 ASR Streaming 0.6B |
| Subtitles with timing, accuracy first | #18 of 26 | 67/100 · Possible fit | Whisper medium |
| Meetings with speaker labels (diarization + timestamps) | #9 of 26 | 77/100 · Strong fit | VibeVoice-ASR 7B |
| CPU-only machine, low memory use | #23 of 26 | 50/100 · Weak fit | VibeVoice-ASR-BitNet |
| Apple Silicon with 8–16 GB unified memory, long recordings | #23 of 26 | 58/100 · Possible fit | Whisper small |
| Japanese live transcription (native streaming, speed first) | #3 of 26 | 83/100 · Strong fit | Nemotron 3.5 ASR Streaming 0.6B |
Supported languages
- English
en - French
fr - German
de - Italian
it - Japanese
ja - Korean
ko - Mandarin Chinese
zh - Portuguese
pt - Russian
ru - Spanish
es
Compare coverage across every reviewed model in the language support matrix.
Community activity on Hugging Face
- Downloads, last 30 days
- 1,810
- Likes
- 66
- Repository last updated
- 3 Sept 2026
- Published on the Hub
- 2 Sept 2026
Figures from the Hugging Face Hub API, 11 Nov 2026. Source: huggingface.co/microsoft/VibeVoice-ASR-Streaming-1.5B ↗. Downloads count file downloads, not active users, and do not affect the matcher's scores. Compare all models.
How to run VibeVoice-ASR Streaming 1.5B locally
The streaming variant runs from the same VibeVoice repository, with a dedicated vLLM streaming server. Runtimes below are the ones the official model card or repository documents for this model (checked November 2, 2026).
- microsoft/VibeVoice ↗Official package · streaming demos
- vLLM streaming server ↗Serving engine · Docker
Install command shown in the official github.com page ↗:
git clone https://github.com/microsoft/VibeVoice.git
cd VibeVoice
pip install -e .
Audio input: Text is emitted once per audio chunk; chunk and look-ahead sizes come from the checkpoint configuration.
Official hardware guidance: Microsoft's documentation uses an NVIDIA GPU container. Source ↗
Whatever runtime you choose, measure speed and accuracy on your own audio with the benchmark tool; results differ a lot between runtimes, precision and hardware.
Before you deploy VibeVoice-ASR Streaming 1.5B
A printable checklist built from the facts on this page. Tick it off before putting the model into production.
- Language. Confirm your language is in the 10-language list on this page, and test any accents or code-switching you expect.
- License. MIT: Include the copyright notice and the permission notice in all copies or substantial portions. Provided as is, without warranty. License guide.
- Install. Start from the official command:
git clone https://github.com/microsoft/VibeVoice.git …(full run notes). - Audio input. Text is emitted once per audio chunk; chunk and look-ahead sizes come from the checkpoint configuration.
- Hardware. Microsoft's documentation uses an NVIDIA GPU container.
- Features you rely on. For VibeVoice-ASR Streaming 1.5B, native streaming is documented; timestamps are limited or runtime-dependent; speaker attribution is native. Test each one you need with real audio.
- Measure. Run 10–20 representative clips, score them with the WER calculator and record speed in the benchmark workspace before you commit.
Alternatives and related models
Same family: VibeVoice-ASR 7B, VibeVoice-ASR-BitNet, VibeVoice-ASR-Streaming-7B.
Similar fit profile: Nemotron 3.5 ASR Streaming 0.6B (NVIDIA, 600M), Voxtral Mini 4B Realtime 2602 (Mistral AI, 4B), Fun-ASR-MLT-Nano-2512 (FunAudioLLM, 800M). Similarity is computed from the ten fit ratings plus streaming and diarization support.
| Fact | VibeVoice-ASR Streaming 1.5B | VibeVoice-ASR 7B | VibeVoice-ASR-BitNet |
|---|---|---|---|
| Provider · size | Microsoft · 3B total | Microsoft · 9B total | Microsoft · 0.3B quantized |
| License | MIT Permissive | MIT Permissive | MIT Permissive |
| Languages | 10 listed languages | 51 listed languages | 7 listed languages |
| Streaming | Native | Batch-first | Via runtime |
| Timestamps | Limited | Yes | Limited |
| Speaker diarization | Native | Native | Separate pipeline |
| CPU · Apple · NVIDIA fit | 1/5 · 2/5 · 4/5 | 1/5 · 2/5 · 4/5 | 5/5 · 4/5 · 3/5 |
| Live · long recordings | 5/5 · 4/5 | 1/5 · 5/5 | 4/5 · 4/5 |
| Main runtime | microsoft/VibeVoice | microsoft/VibeVoice | VibeASR.cpp |
Head-to-head pages: VibeVoice-ASR Streaming 1.5B vs VibeVoice-ASR-Streaming-7B
Compare VibeVoice-ASR Streaming 1.5B side by side
Guides that cover VibeVoice-ASR Streaming 1.5B
- Best local speech-to-text for meetings and speaker attribution
- Best local speech-to-text models in 2026
- Best local speech-to-text models for CPU-only PCs
- Best local speech-to-text models for streaming
- Best local speech-to-text models for multilingual use
- Best local speech-to-text for subtitles and timestamps
Check VibeVoice-ASR Streaming 1.5B for your setup
Pick your language, hardware and workload to see this model's fit score, the reasons behind it and where it ranks against all reviewed models. Everything runs in your browser.
Common questions
Can I use VibeVoice-ASR Streaming 1.5B commercially?
Permissive license; commercial use is allowed under the listed terms. The listed license is MIT; read the current license text ↗ before shipping a product, because terms can change. The license guide compares the obligations of all 26 reviewed models.
Does VibeVoice-ASR Streaming 1.5B support real-time streaming?
Yes. The reviewed source describes a native streaming architecture, so it is a candidate for live captions, dictation or voice agents. Measure end-to-end latency on your own hardware.
Which languages does VibeVoice-ASR Streaming 1.5B transcribe?
10 listed languages. The full list of 10 explicitly enumerated languages is shown above.
Can VibeVoice-ASR Streaming 1.5B tell speakers apart?
Yes. The reviewed source documents native speaker-attributed transcription. Still check accuracy on overlapping speech in your own recordings.
Primary sources
Reviewed against primary sources on September 16, 2026. Model behavior, runtime support, language coverage and licenses can change; re-check the linked primary source before production use. See the full source directory.