| license: llama2 | |
| language: | |
| - en | |
| pipeline_tag: conversational | |
| tags: | |
| - 2.4bpw | |
| - h6 | |
| - exl2 | |
| Exllamav2 2.4bpw h6 quant for [Midnight-Rose-103B-v2.0.3](https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3). | |
| Default calibration dataset. |
| license: llama2 | |
| language: | |
| - en | |
| pipeline_tag: conversational | |
| tags: | |
| - 2.4bpw | |
| - h6 | |
| - exl2 | |
| Exllamav2 2.4bpw h6 quant for [Midnight-Rose-103B-v2.0.3](https://huggingface.co/sophosympatheia/Midnight-Rose-103B-v2.0.3). | |
| Default calibration dataset. |