did you fine-tune your merged model?

#1
by zyh3826 - opened

hi, nice job
I was wondering that did you fine-tune your merged model.

Hi @zyh3826 , thank you for your comments. Regarding your question, the answer is no. There has been no fine-tuning. You can reproduce the same result within 15 minutes and 32 GB RAM (no GPU required) :)

Hi, thank you for your comments. Regarding your question, the answer is no. There has been no fine-tuning. You can reproduce the same result within 15 minutes and 32 GB RAM (no GPU required) :)

So surprised, and so confused. I will try it now, thanks

No problem, if you need any help I will be happy to asist :)

Hi @Weyaxi can you tell me which base model you used when using Ties method? It's Mistral-7B? thanks

Hi @zyh3826 , yes the base model is Mistral-7B.

Thanks for your reply, another thing is your package is https://github.com/cg123/mergekit?

Np and yes it is.

thanks, I'm reciping, hhh

Sign up or log in to comment