How to convert the model to a gguf model?
#3
by
pksorensen
- opened
Hi Mads,
I am playing around and would like to convert it to gguf but have given up now :D (i am a newbie) I came to the conclussion that its based on llama and tried using the llama.cpp convert, but failed to do so. Any pointers ?
Figured it out, was on the right approach but just some currupted files that was messing with me.
Can you share some details on how to convert it to gguf? Would like to try the model in GPT4ALL.
Hi @pksorensen and @tintwotin
I'm sorry about the late reply, I have not been getting any notifications about the discussions.
To convert to gguf, please use llama.cpp: https://github.com/ggerganov/llama.cpp
Remember to use the correct prompt format when chatting with the model :)