<pad> issues on all gemma-2-27b
#2
by
anatolykern
- opened
Anyone having any luck with it?
issue with any prompt on all gemma-2-27b models (8bit,fp16)
Prompt:
^C
There is a tiny bug with the 27B version, and should be fixed soon:
https://github.com/ml-explore/mlx-examples/pull/857
prince-canuma
changed discussion status to
closed
prince-canuma
changed discussion status to
open
Additionally, this model doesn't perform well on fp16, so I'm converting it to bf16.
Source: https://huggingface.co/blog/gemma2