Models
Datasets
Spaces
Posts
Docs
Pricing
Log In
Sign Up

oobabooga
/

llama-tokenizer

Model card Files Files and versions Community

llama-tokenizer

2 contributors

History: 5 commits

oobabooga's picture

Update README.md

5034ac0 over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

304 Bytes

Update README.md over 1 year ago
special_tokens_map.json

411 Bytes

Upload 4 files over 1 year ago
tokenizer.json

1.84 MB

Upload 4 files over 1 year ago
tokenizer.model

500 kB
LFS

Upload 4 files over 1 year ago
tokenizer_config.json

727 Bytes

Upload 4 files over 1 year ago