GPTQ version here
#3
by
Yhyu13
- opened
Hi,
I just made a GPTQ 4 bit 128group actor order version of this model https://huggingface.co/Yhyu13/ShareGPT4V-7B-GPTQ
Since autogptq has not integrated llava model loader, I just modify the config.json and treated it as a llama.
The dataset it is PTQ with was Wikitext2
Thanks! @Yhyu13
Lin-Chen
changed discussion status to
closed