hateBERT EU AI Act Compliance Profile

Tommaso Caselli • Valerio Basile • Jelena Mitrovic • Michael Granizter

Model description

HateBERT is an English pre-trained BERT model obtained by further training the English BERT base uncased model with more than 1 million posts from banned communites from Reddit. The model has been developed as a collaboration between the University of Groningen, the university of Turin, and the University of Passau.

For details, check out the paper presented at WOAH 2021. The code and the fine-tuned models are available on OSF. Fine-tuned models have a different licence, check the dedicated repository.

BibTeX entry and citation info

@inproceedings{caselli-etal-2021-hatebert,
    \ttitle = "{H}ate{BERT}: Retraining {BERT} for Abusive Language Detection in {E}nglish",
    \tauthor = "Caselli, Tommaso  and
      Basile, Valerio  and
      Mitrovi{\'c}, Jelena  and
      Granitzer, Michael",
    \tbooktitle = "Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)",
    \tmonth = aug,
    \tyear = "2021",
    \taddress = "Online",
    \tpublisher = "Association for Computational Linguistics",
    \tturl = "https://aclanthology.org/2021.woah-1.3",
    \tdoi = "10.18653/v1/2021.woah-1.3",
    \tpages = "17--25",
    \tabstract = "We introduce HateBERT, a re-trained BERT model for abusive language detection in English. The model was trained on RAL-E, a large-scale dataset of Reddit comments in English from communities banned for being offensive, abusive, or hateful that we have curated and made available to the public. We present the results of a detailed comparison between a gen

Your obligations as a hateBERT deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages

Library