Load each model using:
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("gagneurlab/SpeciesLM", revision = "<<choose model type>>")
model = AutoModelForMaskedLM.from_pretrained("gagneurlab/SpeciesLM", revision = "<<choose model type>>")
Model type:
- Species LM, 3' region:
downstream_species_lm - Agnostic LM, 3' region:
downstream_agnostic_lm - Species LM, 5' region:
upstream_species_lm - Agnostic LM, 5' region:
upstream_agnostic_lm