Tokenizer file not available
#1
by
talalahmad76
- opened
Hi,
When I try to use the model via the transformers library in python, I get an error that tokenizer file is not available. Which tokenizer file to use then ?
Hi, we used the exact tokenizer provided by Meta. Please refer to meta-llama/Llama-2-13b-chat-hf to download the original tokenizer.