Mistral AI Releases Voxtral 3: Speech-to-Text, TTS and a Voice Agent SDK
Mistral AI just released Voxtral 3. Mistral Voxtral 3 is a speech model family paired with a voice agent SDK. It ships 3 transcription models, 1 text-to-speech model and an SDK built on LiveKit. One place for listening, reasoning, tool calls and speaking. All 4 models are in public preview on the Mistral API.
Mistral lists 4 models and 1 SDK:
All transcription models support diarization and context biasing. Context biasing takes key terms or free text to improve recall. Batch transcription covers 50 languages, including 24 official EU languages.
The SDK is built on LiveKit and runs 3 stages as 1 streaming pipeline. Realtime Transcribe 3 listens and detects when the caller stops speaking. A general LLM, such as Mistral Small 4, reasons and calls tools. Voxtral Speech 3 replies in the tone of the conversation so far.
Each turn completes in under 1 second. The agent stops talking when the caller cuts in. It handles phone calls over SIP and browser or app sessions over WebRTC. Because each stage is a separate model, teams can swap the LLM, voice or language.
These numbers are self-reported by Mistral:
On Artificial Analysis, Small scores 2.1% AA-WER and Mini 2.2%. Only Fun-Realtime-ASR-preview (1.7%) and MAI-Transcribe-2 (2.0%) rank higher. Speed is the gap: Small’s speed factor is 65.8x, against 307.5x for MAI-Transcribe-2.
On FLEURS 35, the realtime model trades latency for accuracy. It scores 5.7% WER at 2,400 ms and 6.4% at 480 ms. At 240 ms, WER rises to 7.4%. Gemini 3.5 Realtime Transcribe scores 4.2% and MAI-Transcribe-2 Streaming 5.8%. GPT Live Transcribe (8.4%) and Scribe v2 Realtime (8.7%) trail every Voxtral setting.
Voxtral Speech 3 costs $13 per 1M characters. Mistral says that undercuts OpenAI TTS-1, Deepgram, ElevenLabs Flash and Gemini Flash. Explicit controls cover emotion, pacing and emphasis. The model page lists ~90 ms time-to-first-audio and 34 emotion tags. Pro Voice adapts a speaker’s style from 30 minutes of audio. Artificial Analysis places it in the top 12 of both TTS arenas.
The models run on Mistral’s European, US and global endpoints. OpenRouter also lists all 3 new models with EU-hosted, zero-data-retention endpoints.
Check out the Voxtral 3 announcement, the audio docs and the model pages. All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.
Asif Razzaq is the CEO of Marktechpost AI Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.
Datalab Releases OmniParseBench: An Open OCR Benchmark With 16,288 Pass/Fail Tests
The newsletter 70,000+ AI builders read. Model releases, tools and research, without the hype.
Practitioner-first AI/ML news and analysis, read by 1M+ developers and researchers every month.