Merak-7B-v2.ggmlv3.q4_0.bin
#2
by
Sandrian
- opened
First of all thank you for this great enhancement to provide merak llm in ggml version.
I want to ask, did you test the Merak-7B-v2.ggmlv3.q4_0.bin yet? i already tried this model with Bahasa Indonesia prompt but no output to show. But it goes well when i tried with English prompt
Thank you
same me too, is there a trigger prompt for this model?
Did you use oobabooga's textgen? It's working fine either in chat mode or Default mode with QA prompt.
According to the Merak's model card the prompt format is following:
<|prompt|>{question}\n<|answer|>
Btw, try out further fine-tuned Merak: 🦚Merak-7B-v3-Mini-Orca-GGUF🐳
Compared to Merak-7B-v2, it gives more coherent and longer answer.