---
datasets:
- oscar-corpus/OSCAR-2201
- mc4
language:
- he
pipeline_tag: fill-mask
---


## Hebrew Language Model

State-of-the-art Longformer language model for Hebrew.

#### How to use

```python

from transformers import AutoModelForMaskedLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained('HeNLP/LongHeRo')
model = AutoModelForMaskedLM.from_pretrained('HeNLP/LongHeRo')

```