4_K_M, 5_K_M?
#1
by
kalomaze
- opened
I'm really liking this one so far and wanted to try higher quants if you could make them.
https://huggingface.co/Artefact2/Nous-Hermes-2-Mixtruct-v0.1-8x7B-DPO-DARE_TIES-GGUF/blob/main/Nous-Hermes-2-Mixtruct-v0.1-8x7B-DPO-DARE_TIES-Q4_K_M.gguf
https://huggingface.co/Artefact2/Nous-Hermes-2-Mixtruct-v0.1-8x7B-DPO-DARE_TIES-GGUF/blob/main/Nous-Hermes-2-Mixtruct-v0.1-8x7B-DPO-DARE_TIES-Q5_K_M.gguf
https://huggingface.co/Artefact2/Nous-Hermes-2-Mixtruct-v0.1-8x7B-DPO-DARE_TIES-GGUF/blob/main/Nous-Hermes-2-Mixtruct-v0.1-8x7B-DPO-DARE_TIES-Q6_K.gguf
Artefact2
changed discussion status to
closed
Thank you!