parsig_tokenizer / added_tokens.json
hamedjahantigh's picture
Upload tokenizer
8e5badd
raw
history blame
86 Bytes
{
"</s>": 6882,
"<mask>": 6885,
"<pad>": 6884,
"<s>": 6881,
"<unk>": 6883
}