Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be greater than or equal to 2
This is a 1.0bpw quantized version of Qwen/Qwen2.5-32B-Instruct made with exllamav2.
License
This model is available under the Apache 2.0 License.
Discord Server
Join our Discord server here.
Feeling Generous? 😊
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?
- Downloads last month
- 8