Is there any chance of getting this into a 4bit quantized (GPTQ as well?) version?
#1
by
cleverest
- opened
NM, I just noticed the file is exactly that already, haha!
NM, I just noticed the file is exactly that already, haha!