anon8231489123

/

vicuna-13b-GPTQ-4bit-128g

like 667

Hello, I am following a tutorial to get vicuna working through a UI via oobabooga & in the tutorial it says to add --wbits 4 --groupsize 128 after "call python webui.py" in my start.bat file. I did that, like so:

However, when I try to run the start.bat file I get prompted with this error:

Any help on this would be greatly appreciated! I was able to launch the UI without having --chat --wbits4 --groupsize 128 in the start file, but it was riddled with errors, and obviously the chatbot did not generate any responses to my input.