Upload added_tokens.json
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"<BOS>": 50257, "<fantasy>": 50263, "<humor-&-comedy>": 50266, "<paranormal>": 50265, "<mystery-&-detective>": 50262, "<adventure>": 50261, "<EOS>": 50258, "<romance>": 50260, "<PAD>": 50259, "<science-fiction>": 50264}
|