GGUF?
#1
by
Goldenblood56
- opened
I don't know how good this model is or not. But if anyone has it if GGUF I would try it out. Thank you. But don't quantize this just for me though.
The best 7B model according to the leaderboard deserves a quantization for sure
Hello, thanks for your feedback. I am starting to work on it.
Edit:
Its only 8-bit quantization for now, but lets try this: https://huggingface.co/bardsai/jaskier-7b-dpo-v6-GGUF
