Feedback
Tried out this model today with various SFW and NSFW character cards. So far i like the model, a little on the horny side but nothing i can't handle. It gets stuck in some kind of repetitive answer sometimes and i have to force it out of it by regenerating a lot. But so far i find it really good in it's wording and role playing. I wish i could try out the 13b MoE models but my hardware just can't handle it (32RAM 8VRAM). Looking forward to future models from you 👍
Thanks a lot for the feedback! Did you used a "K" quant? Because they seems to have an issue, maybe using a "_0" quant will fix some of them
I know about the bugs of the "K" quants. I use the Q4 one at the moment. Just had it with only one character that it kept repeating a certain scene over and over with only minor changes in it. So i had to regenerate until it came up with something completely different. I will try the Toppy Mix 4x7b tomorrow and give some feedback on that as well. Thank you for your work.
I can confirm the above statement with q4 k-quant. It's very repetitive. In my best settings for such cases, it now tends to repeat given paragraphs with minimal changes in every reply, but often adds another paragraph with new text behind this. Downloading q4 _0 quant now.