alvocat vocos 22khz EU AI Act Compliance Profile

🥑 alVoCat

🥑 alVoCat is a vocoder for Catalan TTS, based on Vocos architecture. It is highly performant and high quality, works together with 🍵 Matxa and you can find our fork here and a demo here.

Model Details

Model Description

Vocos is a fast neural vocoder designed to synthesize audio waveforms from acoustic features. Unlike other typical GAN-based vocoders, Vocos does not model audio samples in the time domain. Instead, it generates spectral coefficients, facilitating rapid audio reconstruction through inverse Fourier transform.

This version of Vocos uses 80-bin mel spectrograms as acoustic features which are widespread in the TTS domain since the introduction of hifi-gan The goal of this model is to provide an alternative to hifi-gan that is faster and compatible with the acoustic output of several TTS models. This version is tailored for the Catalan language, as it was trained only on Catalan speech datasets.

We are grateful with the authors for open sourcing the code allowing us to modify and train this version.

Intended Uses and limitations

The model is aimed to serve as a vocoder to synthesize audio waveforms from mel spectrograms. Is trained to generate speech and if is used in other audio domain is possible that the model won't produce high quality samples.

How to Get Started with the Model

Use the code below to get started with the model.

Installation

To use Vocos only in inference mode, install it using:

Your obligations as a alvocat vocos 22khz deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags