unable to generate content
#1
by
meigami
- opened
How do you run this model normally by ExllamaV2
I only get meaningless blank characters
Is there anything that needs to be modified?
can confirm; the quant ran through just fine but it seems to not work properly; moved to archive.
lucyknada
changed discussion status to
closed
I've opened an issue on the exllama repo, feel free to subscribe to it; I'll requant once there's full support.
lucyknada/IndexTeam_Index-1.9B-Chat-exl2-6.0bpw