IQ1_S
#3
by
VxeR
- opened
Any chance for a IQ1_S quant? Would be greatly appreciated
IQ1_S has had two changes yesterday that broke backward compatibility, forcing me to remove a bunch of published IQ1_S GGUFs. Things will be messy for a while until these changes propagate downstream. Maybe then I'll reconsider uploading IQ1_S, in the meantime you can quantize it yourself by grabbing the imatrix file from this repo.
I see, guess I'll wait for things to settle down then (would also love a quant of lzlv when that happens!)
VxeR
changed discussion status to
closed