Spaces:
Running
Running
File size: 151 Bytes
5425d5d |
1 2 3 4 5 6 7 |
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("google/gemma-7b", trust_remote_code=True)
tokenizer.comments = "" |