moonshine-tiny-zh EU AI Act Compliance Profile

Moonshine

[Paper] [Code]

This is the model card for running the automatic speech recognition (ASR) models (Moonshine models) trained and released by Moonshine AI (f.k.a Useful Sensors.)

Following Model Cards for Model Reporting (Mitchell et al.), we're providing some information about the automatic speech recognition model. More information on how these models were trained and evaluated can be found in the paper. Note, a lot of the text has been copied verbatim from the model card for the Whisper model developed by OpenAI, because both models serve identical purposes, and carry identical risks.

Usage

Moonshine is supported in Hugging Face 🤗 Transformers. To run the model, first install the Transformers library. For this example, we'll also install 🤗 Datasets to load toy audio dataset from the Hugging Face Hub, and 🤗 Accelerate to reduce the model loading time:

pip install --upgrade pip
pip install --upgrade transformers datasets[audio]

from transformers import MoonshineForConditionalGeneration, AutoProcessor
from datasets import load_dataset, Audio
import torch

device = "cuda:0" if torch.cuda.is_available() else "cpu"
torch_dtype = torch.float16 if torch.cuda.is_available() else torch.float32

model = MoonshineForConditionalGeneration.from_pretrained('UsefulSensors/moonshine-tiny-zh').to(device).to(torch_dtype)
processor = AutoProcessor.from_pretrained('UsefulSensors/moonshine-tiny-zh')

dataset = load_dataset('UsefulSensors/multilingual_examples', split='zh')
dataset = dataset.cast_column("audio", Audio(processor.feature_extractor.sampling_rate))
sample = dataset[0]["audio"]

inputs = processor(
    sample["array"], 
    return_tensors="pt",
    sampling_rate=processor.feature_extractor.sampling_rate
)
inputs = inputs

Your obligations as a moonshine-tiny-zh deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.