xlsr-a-nomi / added_tokens.json
susmitabhatt's picture
Upload tokenizer
3fa987c verified
raw
history blame
30 Bytes
{
"</s>": 29,
"<s>": 28
}