fusedyi / added_tokens.json
pharaouk's picture
Upload tokenizer
f45123c verified
raw
history blame contribute delete
57 Bytes
{
"<|endoftext|>": 64001,
"<|startoftext|>": 64000
}