Quantizations of the model: | |
- https://huggingface.co/TehVenom/Metharme-13b-Merged | |
Under the following versions: | |
- Q4_1 (4bit); | |
- Q5_1 (5bit); | |
- Q8_0 (8bit). |
Quantizations of the model: | |
- https://huggingface.co/TehVenom/Metharme-13b-Merged | |
Under the following versions: | |
- Q4_1 (4bit); | |
- Q5_1 (5bit); | |
- Q8_0 (8bit). |