UBC-NLP
/

AraT5-msa-base

Arabic Machine Translation

Arabic Text Summarization

Arabic News Title and Question Generation

Arabic Paraphrasing and Transliteration

Arabic Code-Switched Translation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

AraT5-msa-base / tokenizer_config.json

m-nagoudi's picture

Update tokenizer_config.json

bd166a1 over 2 years ago

81 Bytes

{"eos_token": "</s>", "unk_token": "<unk>", "pad_token": "<pad>", "extra_ids": 0}