roberta-base-32k / tokenizer_config.json
bab2min's picture
Added RoBERTa-base-32k
90ee9b6
raw
history blame
71 Bytes
{
"model_max_length": 512,
"tokenizer_class": "KiwiTokenizer"
}