Mayank Mishra commited on
Commit
ad5230a
1 Parent(s): d830485

Add eos_token_id to generation config

Browse files

Currently, the model never stops generating because the eos_token_id is None inside HF generate function.
The eos_token_id is inferred from the generation config.
This token id can be passed in explicitely but its better to have it in the config.

Files changed (1) hide show
  1. generation_config.json +1 -0
generation_config.json CHANGED
@@ -1,5 +1,6 @@
1
  {
2
  "_from_model_config": true,
3
  "transformers_version": "4.28.1",
 
4
  "use_cache": false
5
  }
 
1
  {
2
  "_from_model_config": true,
3
  "transformers_version": "4.28.1",
4
+ "eos_token_id": 0,
5
  "use_cache": false
6
  }