musicgen melody EU AI Act Compliance Profile

MusicGen - Melody - 1.5B

Audiocraft provides the code and models for MusicGen, a simple and controllable model for music generation. MusicGen is a single stage auto-regressive Transformer model trained over a 32kHz EnCodec tokenizer with 4 codebooks sampled at 50 Hz. Unlike existing methods like MusicLM, MusicGen doesn't not require a self-supervised semantic representation, and it generates all 4 codebooks in one pass. By introducing a small delay between the codebooks, we show we can predict them in parallel, thus having only 50 auto-regressive steps per second of audio.

MusicGen was published in Simple and Controllable Music Generation by Jade Copet, Felix Kreuk, Itai Gat, Tal Remez, David Kant, Gabriel Synnaeve, Yossi Adi, Alexandre Défossez.

Four checkpoints are released:

• small
• medium
• large
• melody (this checkpoint)

Example

Try out MusicGen yourself!

• <a target="_blank" href="https://colab.research.google.com/drive/1fxGqfg96RBUvGxZ1XXN07s3DthrKUl4-?usp=sharing"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>

• <a target="_blank" href="https://huggingface.co/spaces/facebook/MusicGen"> <img src="https://huggingface.co/datasets/huggingface/badges/raw/main/open-in-hf-spaces-sm.svg" alt="Open in HugginFace"/>

• You can run MusicGen locally as well:

1. First install the audiocraft library

1. Make sure to have ffmpeg installed:

1. Run the following Python code:

import torchaudio
from audiocraft.models import MusicGen
from audiocraft.data.audio imp

Your obligations as a musicgen melody deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Library