Voxtral-Mini-4B-Realtime-2602 EU AI Act Compliance Profile

Voxtral Mini 4B Realtime 2602

Voxtral Mini 4B Realtime 2602 is a multilingual, realtime speech-transcription model and among the first open-source solutions to achieve accuracy comparable to offline systems with a delay of <500ms. It supports 13 languages and outperforms existing open-source baselines across a range of tasks, making it ideal for applications like voice assistants and live subtitling.

Built with a natively streaming architecture and a custom causal audio encoder - it allows configurable transcription delays (240ms to 2.4s), enabling users to balance latency and accuracy based on their needs. At a 480ms delay, it matches the performance of leading offline open-source transcription models, as well as realtime APIs.

As a 4B-parameter model, is optimized for on-device deployment, requiring minimal hardware resources. It runs in realtime with on devices minimal hardware with throughput exceeding 12.5 tokens/second.

This model is released in BF16 under the Apache-2 license, ensuring flexibility for both research and commercial use.

For more details, see our:

• Blog post
• Demo
• Technical report
• vLLM's blog on streaming input

Key Features

Voxtral Mini 4B Realtime consists of two main architectural components:

• ≈3.4B Language Model
• ≈970M Audio Encoder
• The audio encoder was trained from scratch with causal attention enabling streaming capability
• Both the audio encoder as well as the LLM backbone use sliding window attention allowing for "infinite" streaming
• For more details, refer to the technical report

The Voxtral

Your obligations as a Voxtral-Mini-4B-Realtime-2602 deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages

Library

Base Model