koala-13B-HF / tokenizer_config.json

Commit History

Update tokenizer_config.json to match other models, like Vicuna - the Koala conversion process does not fill out this file, but based on the code I think these special tokens should be defined.
5ef2fa3

TheBloke commited on

Add model files.
9ae37cd

TheBloke commited on