Hugging Face's logo

mshojaei77
/
PersianBPETokenizer

Text Generation
Transformers
Persian
Tokenizer
persian
bpet
Inference Endpoints
Model card Files Community
1
New discussion

I think hazm still performs better than this tokenizer
#1 opened 20 days ago by Waisullah