Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

Manu101
/

HindiTokenizer

Sleeping

App Files Files Community

HindiTokenizer / src

1 contributor

History: 1 commit

Manu101's picture

Upload 12 files

693faa9 verified 5 months ago

__pycache__
Upload 12 files 5 months ago
Basictokenizer.py

7.37 kB

Upload 12 files 5 months ago
HindiTokenizer.py

23.5 kB

Upload 12 files 5 months ago
HuggingFace-based-tokenizer.py

2.95 kB

Upload 12 files 5 months ago
__init__.py

117 Bytes

Upload 12 files 5 months ago
base.py

6.77 kB

Upload 12 files 5 months ago