bsc bio ehr es EU AI Act Compliance Profile

Biomedical-clinical language model for Spanish

Table of contents

• Model description
• Intended uses and limitations
• How to use
• Limitations and bias
• Training
• Evaluation
• Additional information
  • Author
  • Contact information
  • Copyright
  • Licensing information
  • Funding
  • Citing information
  • Disclaimer

Model description

Biomedical pretrained language model for Spanish. For more details about the corpus, the pretraining and the evaluation, check the official repository.

Intended uses and limitations

The model is ready-to-use only for masked language modelling to perform the Fill Mask task (try the inference API or read the next section). However, it is intended to be fine-tuned on downstream tasks such as Named Entity Recognition or Text Classification.

How to use

Limitations and bias

At the time of submission, no measures have been taken to estimate the bias embedded in the model. However, we are well aware that our models may be biased since the corpora have been collected using crawling techniques on multiple web sources. We intend to conduct research in these areas in the future, and if completed, this model card will be updated.

Training

Tokenization and model pretraining

This model is a RoBERTa-based model trained on a biomedical-clinical corpus in Spanish collected from several sources (see next section). The training corpus has been tokenized using a byte version of Byte-Pair Encoding (BPE) used in the original [RoBERTA](htt

Your obligations as a bsc bio ehr es deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages

Library