Commit
•
5a78a9b
1
Parent(s):
eab4154
Updated to reflect changes in pr #3
Browse files
README.md
CHANGED
|
@@ -182,6 +182,7 @@ Please see the Responsible Use Guide available at https://ai.meta.com/llama/resp
|
|
| 182 |
|
| 183 |
To run the GPTQ version you first need to install transformers, peft, accelerate optimum and auto-gptq
|
| 184 |
pip install -q -U transformers peft accelerate optimum
|
|
|
|
| 185 |
pip install auto-gptq --extra-index-url https://huggingface.github.io/autogptq-index/whl/cu117/
|
| 186 |
|
| 187 |
Then you can run the model with:
|
|
|
|
| 182 |
|
| 183 |
To run the GPTQ version you first need to install transformers, peft, accelerate optimum and auto-gptq
|
| 184 |
pip install -q -U transformers peft accelerate optimum
|
| 185 |
+
|
| 186 |
pip install auto-gptq --extra-index-url https://huggingface.github.io/autogptq-index/whl/cu117/
|
| 187 |
|
| 188 |
Then you can run the model with:
|