riotu-lab
/

Aranizer-PBE-64k

Arabic Tokenizer

Model card Files Files and versions Community

riotu-lab commited on Aug 25

Commit

d71e212

•

1 Parent(s): 561a307

update readme.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ tags:
 - Aranizer
 - Arabic Tokenizer
 - PBE
-- transformers
 ---
 # Aranizer | Arabic Tokenizer

 - Aranizer
 - Arabic Tokenizer
 - PBE
+- AutoTokenizer
 ---
 # Aranizer | Arabic Tokenizer