mobiuslabsgmbh
/

Mixtral-8x7B-v0.1-hf-2bit_g16_s128-HQQ

Text Generation

Mixture of Experts

Model card Files Files and versions Community

mobicham commited on Dec 11, 2023

Commit

509797f

•

1 Parent(s): 6e044ad

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,7 +5,7 @@ inference: false
 pipeline_tag: text-generation
 ---
 ## Mixtral-8x7B-v0.1-hf-2bit_g16_s128-HQQ
-This is a version of the Mixtral-8x7B-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) quantized to 2-bit via Half-Quadratic Quantization (HQQ): https://mobiusml.github.io/hqq_blog/
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python

 pipeline_tag: text-generation
 ---
 ## Mixtral-8x7B-v0.1-hf-2bit_g16_s128-HQQ
+This is a version of the Mixtral-8x7B-v0.1 model (https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) quantized to 2-bit via Half-Quadratic Quantization (HQQ).
 ### Basic Usage
 To run the model, install the HQQ library from https://github.com/mobiusml/hqq and use it as follows:
 ``` Python