gradjitta

/

Poro-34B-AWQ

like 1

Hi,
I managed to load and use this model in text-generation-webui by editing tokenizer_config.json. Needed to change line 225 to

"tokenizer_class": "BloomTokenizerFast",

Kiitos/Thank you for the AWQ quant!