AIDO.RNA 1.6B EU AI Act Compliance Profile

AIDO.RNA-1.6B

AIDO.RNA-1.6B is a general-purpose RNA foundation model with 1.6 billion parameters, trained on 42 million non-coding RNA sequences at single-nucleotide resolution. It achieves state-of-the-art performance on a comprehensive set of tasks, including RNA secondary structure prediction, mRNA-related tasks, RNA function prediction, and RNA inverse folding. After domain adaptation, AIDO.RNA excels in modeling protein-level tasks, highlighting its potential to leverage the central dogma for enhancing biomolecular representations. For more detailed information, please refer to our paper.

Note: If you are interested in a model tailored for coding sequences, we also offer a domain-adapted version: AIDO.RNA-1.6B-CDS.

Model architectural details

AIDO.RNA is an encoder-only transformer and is pre-trained using masked language modeling (MLM) objective. The model architecture parameters are as follows: | hyperparameter | value | | :---: | :----: | | num-layers | 32 | | hidden-size | 2,048 | | ffn-hidden-size | 5,440 | | num-attn-heads | 32 | | vocab-size | 16 |

Pre-training data

The pre-training data contains 42 million unique ncRNA sequences from RNAcentral version 24.0.

Downstream evaluation

Your obligations as a AIDO.RNA 1.6B deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags