Quantized model GGUF
#1
by
MaziyarPanahi
- opened
Thanks for your work and sharing it with the community. I have quantized this model in GGUF if anyone needs it: https://huggingface.co/MaziyarPanahi/BioMistral-7B-GGUF