GGUF quants
#2
by
Artefact2
- opened
Hi Sophosympatheia,
I've quantized your model in GGUF format, including the new 2-bit variants. You can find them here:
https://huggingface.co/Artefact2/Midnight-Rose-70B-v1.0-GGUF
Regards
Thanks for that contribution! I'll link and attribute on the model card page.
sophosympatheia
changed discussion status to
closed