Just a q8_0 and q4_0 version. If you need versions with other quantization parameters, please let me know
- Downloads last month
- 170
Inference API (serverless) is not available, repository is disabled.
Just a q8_0 and q4_0 version. If you need versions with other quantization parameters, please let me know