Version 12b?
#1
by
Anonimus12345678902
- opened
Will there be a version 12b gguf for video cards with 12 gigabytes of video memory?
https://huggingface.co/anthracite-org/magnum-v2-12b-gguf
https://huggingface.co/anthracite-org/magnum-v2.5-12b-kto-gguf
we do not currently plan a v3 for 12b however, but you might like the upcoming models, keep an eye out.
lucyknada
changed discussion status to
closed