4bit quantized version needed

by deleted - opened Jul 4, 2023

deleted

Jul 4, 2023

Could you please make a 4bit quantized version of this model? Thanks!

Owner Jul 4, 2023

Got the request, and I'll update the GPTQ-4bit-128g about it

deleted

Jul 5, 2023

Got the request, and I'll update the GPTQ-4bit-128g about it

Thank you for your effort！

deleted changed discussion status to closed Jul 5, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment