Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
xu-song
/
tokenizer-arena
like
57
Running
App
Files
Files
Community
1
bce41d0
tokenizer-arena
/
vocab
/
chatglm_6b
/
chatglm_6b
2 contributors
History:
2 commits
xu-song
fix chatglm; new feature about add_special_tokens;
d27a756
10 months ago
config.json
Safe
697 Bytes
add more tokenizers
12 months ago
ice_text.model
Safe
2.7 MB
LFS
add more tokenizers
12 months ago
tokenization_chatglm.py
Safe
12.5 kB
fix chatglm; new feature about add_special_tokens;
10 months ago
tokenizer_config.json
Safe
416 Bytes
add more tokenizers
12 months ago