More GGUF sizes
#3
by
bartowski
- opened
Just renamed my model page to match your rename, thought you might be interested in a few more GGUF sizes :)
https://huggingface.co/bartowski/Llama-3.1-70B-Instruct-lorablated-GGUF/
Thanks @bartowski ! Adding your link to the model card now
Hi
I uploaded @bartowski 's q8 GGUF to ollama: https://ollama.com/tarruda/llama3.1-70b-instruct-lorablated