Hugging Face's logo

anon8231489123
/
gpt4-x-alpaca-13b-native-4bit-128g

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
55

Gpt4-x-alpaca gives gibberish numbers instead of words

#33
by Snim - opened
Discussion
Snim

I am using it with ooga-booga UI. I used other models such as Vicuna and they work fine, however, when using it with gpt4-x-alpaca I get gibberish numbers instead of words. These are probably tokens which are not translated.
For example
me: How are you
bot: 2(1-0-4322-W (1--141-1-,_~°2 h-2-6-2-42518-Next12-71-1-14-2-12-42(-

Can somebody help me with this?

DonCoca

Same Problem here!

Snim

@DonCoca Figured out a solution. Go to the folder where modle is located. You may find that there are 2 modles instead of one. Delete one. If you have cuda delete the one which does not have cuda in its name.

DonCoca

@DonCoca Figured out a solution. Go to the folder where modle is located. You may find that there are 2 modles instead of one. Delete one. If you have cuda delete the one which does not have cuda in its name.

Thank you so much! This is the solution to the problem. Have a great day!

MeleeMech

@DonCoca Figured out a solution. Go to the folder where modle is located. You may find that there are 2 modles instead of one. Delete one. If you have cuda delete the one which does not have cuda in its name.

Bless you!!

Sign up or log in to comment