specter2 EU AI Act Compliance Profile

SPECTER2

SPECTER2 is a family of models that succeeds SPECTER and is capable of generating task specific embeddings for scientific tasks when paired with adapters. Given the combination of title and abstract of a scientific paper or a short texual query, the model can be used to generate effective embeddings to be used in downstream applications.

Note:For general embedding purposes, please use allenai/specter2.

To get the best performance on a downstream task type please load the associated adapter () with the base model as in the example below.

Dec 2023 Update:

Model usage updated to be compatible with latest versions of transformers and adapters (newly released update to adapter-transformers) libraries.

Aug 2023 Update:

1. The SPECTER2 Base and proximity adapter models have been renamed in Hugging Face based upon usage patterns as follows:

|Old Name|New Name| |--|--| |allenai/specter2|allenai/specter2_base| |allenai/specter2_proximity|allenai/specter2|

1. We have a parallel version (termed aug2023refresh) where the base transformer encoder version is pre-trained on a collection of newer papers (published after 2018). However, for benchmarking purposes, please continue using the current version.

Adapter allenai/specter2 for allenai/specter2_base

An adapter for the allenai/specter2_base model that was trained on the allenai/scirepeval dataset.

This adapter was created for usage with the adapters library

Your obligations as a specter2 deployer

Track your progress

Sign up to track obligations, receive deadline reminders, and generate audit packages.

Tags

Library