Hugging Face's logo

kumarme072
/
mytoken_model_1

Fill-Mask
Transformers
Safetensors
bert
Inference Endpoints
Model card Files Community
kumarme072 commited on
Commit
6d9bd88
•
1 Parent(s): e3e43cd

Upload tokenizer

Browse files
Files changed (5) hide show
  1. .gitattributes +1 -0
  2. added_tokens.json +0 -0
  3. special_tokens_map.json +7 -0
  4. tokenizer_config.json +3 -0
  5. vocab.txt +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer_config.json filter=lfs diff=lfs merge=lfs -text
added_tokens.json ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": "[CLS]",
3
+ "mask_token": "[MASK]",
4
+ "pad_token": "[PAD]",
5
+ "sep_token": "[SEP]",
6
+ "unk_token": "[UNK]"
7
+ }
tokenizer_config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51ddf6ff33e2625dedfaff45b8aaf028d75b37d0c7c0ca8d83260462d2a44681
3
+ size 13610788
vocab.txt ADDED
The diff for this file is too large to render. See raw diff