Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
4.5bpw EXL2 quant of https://huggingface.co/TheDrummer/Cydonia-22B-v1.3
6bit heads. Default measurement dataset.
- Downloads last month
- 45
4.5bpw EXL2 quant of https://huggingface.co/TheDrummer/Cydonia-22B-v1.3
6bit heads. Default measurement dataset.