numnum8_beta / added_tokens.json
krittapol's picture
Upload tokenizer
83e979e verified
raw
history blame
94 Bytes
{
"<CLS>": 41070,
"<EOD>": 41072,
"<MASK>": 41073,
"<PAD>": 41074,
"<SEP>": 41071
}