riotu-lab
/

Aranizer-PBE-64k

Arabic Tokenizer

Model card Files Files and versions Community

Aranizer-PBE-64k / tokenizer.json

riotu-lab's picture

Upload tokenizer

09ae685 verified 3 months ago

4.25 MB

File too large to display, you can check the raw version instead.