Impressive.
#1
by
e-n-v-y
- opened
do other 70b models not get this?! xD
cool that mine looks like it works well, tho
This is the first one I tested it on. Oddly, the others failed. It also seems to break down on quants lower than Q5_k_s on this one.
That being said, it's a small sample size (one test per model) so there could be at least some amount of luck involved, although I was playing Skyrim Mantella with this model as the backend and it happened there too, completely by accident.
Gemma 27B missed it, but acted surprised when I pointed it out. Smaller models had trouble with the concept that Bob was in a different room at all.