Thank you!
#2
by
Puchacz19
- opened
The king has deliver another banger. Thanks! I hope The Bloke will make gguf quants now.
Thank you for the kind words. I included a exl2 measurement file based on the pippa dataset to help accelerate the production of exl2 "rpcal" quants. I am going to try to do that for all my models going forward.
sophosympatheia
changed discussion status to
closed
@Puchacz19 , you can find a few of my quants here: https://huggingface.co/Artefact2/Midnight-Rose-103B-v1.0-GGUF
Regards