bert-base-NER-Russian EU AI Act Compliance Profile

Russian Named Entity Recognition Model

Model description

This model is a fine-tuned version of bert-base-multilingual-cased for Named Entity Recognition (NER) in Russian text. It can identify various entity types such as person first names, middle names, last names, cities, districts, etc using the BIOLU tagging format.

Intended uses & limitations

The model is designed to identify named entities in Russian text. It can be used for tasks such as information extraction, content analysis, and text preprocessing for downstream NLP tasks.

How to use

Here's a simple example of how to use the model:

from transformers import pipeline

ner_pipe = pipeline("ner", model="Gherman/bert-base-NER-Russian")

text = "Меня зовут Сергей Иванович из Москвы."
results = ner_pipe(text)

for result in results:
    print(f"Word: {result['word']}, Entity: {result['entity']}, Score: {result['score']:.4f}")

Limitations and bias

• The model's performance may vary depending on the domain and style of the input text.
• It may struggle with rare or complex entity names not seen during training.
• The model might exhibit biases present in the training data.

Training data

The model was trained on Detailed-NER-Dataset-RU by AlexKly. Check it out, the dataset is pretty good!

Label Information

The dataset is labeled using the BIOLU format, where:

• B: Beginning token of an entity
• I: Inner token of an entity
• O: Other (non-entity) token
• L: Last token of an entity
• U: Unit token (single-token entity)

The following entity types are included in the dataset:

Location (LOC) tags:

• COUNTRY
• REGION
• CITY
• DISTRICT
• STREET
• HOUSE

Person (PER) tags:

• LAST_NAME
• FIRST_NAME
• MIDDLE_NAME

For example, a full tag might look like "B-CITY" for the beginning token of a city name, or "U-COUNTRY" for a single-token country name.

Training procedure

The model was fine-tuned from the `bert-base-m

Your obligations as a bert-base-NER-Russian deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Languages

Library

Base Model