Can the quantized model support Chinese?
#8
by
FancyPig
- opened
Can quantized model support Chinese well? I tried using text-generation-webui, but it seems unable to respond well to Chinese.The quantized model, when I tried to ask him questions in Chinese, he only replied with 1-2 words each time, and the response time was a bit long. I don't think it's a problem with my configuration. I'm using a server with 24 cores, 93GB RAM, and 16GB VRAM.
The quantized model itself supports Chinese, it should be a problem of text-generation-webui.
