Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena

2 contributors

History: 36 commits

xu-song's picture

add more tokenizers

a1b0cd0 12 months ago

css
update about 1 year ago
images
update about 1 year ago
js
update about 1 year ago
utils
update 12 months ago
vocab
add more tokenizers 12 months ago
.gitattributes

1.68 kB

add more tokenizers 12 months ago
.gitignore

171 Bytes

update about 1 year ago
README.md

380 Bytes

update 12 months ago
app.py

7.18 kB

add more tokenizers 12 months ago
config.py

20 Bytes

add more tokenizers 12 months ago
evaluation.md

58 Bytes

update about 1 year ago
examples.py

2.37 kB

add more tokenizers 12 months ago
requirements.txt

52 Bytes

update 12 months ago
util.py

5.58 kB

add more tokenizers 12 months ago