DialoGPT-large / tokenizer_config.json
Wauplin's picture
Wauplin HF staff
Add `eos_token` to the tokenizer config.
58feb13 verified
raw
history blame
162 Bytes
{
"model_max_length": 1024,
"chat_template": "{% for message in messages %}{{ message.content }}{{ eos_token }}{% endfor %}",
"eos_token": "<|endoftext|>"
}