AI_Camp_NLP / added_tokens.json
chowdhuryshaif's picture
Upload added_tokens.json with huggingface_hub (#9)
c26b07c
raw
history blame
51 Bytes
{
"<|pad|>": 50258,
"<|startoftext|>": 50257
}