Update README.md
Browse files
README.md
CHANGED
@@ -48,6 +48,8 @@ tags:
|
|
48 |
|
49 |
This repo contains GPTQ model files for [Microsoft's Phi 2](https://huggingface.co/microsoft/phi-2).
|
50 |
|
|
|
|
|
51 |
Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
|
52 |
|
53 |
<!-- description end -->
|
@@ -93,7 +95,7 @@ Multiple quantisation parameters are provided, to allow you to choose the best o
|
|
93 |
|
94 |
Each separate quant is in a different branch. See below for instructions on fetching from different branches.
|
95 |
|
96 |
-
|
97 |
|
98 |
<details>
|
99 |
<summary>Explanation of GPTQ parameters</summary>
|
@@ -191,6 +193,8 @@ Note that using Git with HF repos is strongly discouraged. It will be much slowe
|
|
191 |
|
192 |
Please make sure you're using the latest version of [text-generation-webui](https://github.com/oobabooga/text-generation-webui).
|
193 |
|
|
|
|
|
194 |
It is strongly recommended to use the text-generation-webui one-click-installers unless you're sure you know how to make a manual install.
|
195 |
|
196 |
1. Click the **Model tab**.
|
|
|
48 |
|
49 |
This repo contains GPTQ model files for [Microsoft's Phi 2](https://huggingface.co/microsoft/phi-2).
|
50 |
|
51 |
+
**NOTE** These GPTQs will only work with Transformers, and require `trust_remote_code=True`.
|
52 |
+
|
53 |
Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
|
54 |
|
55 |
<!-- description end -->
|
|
|
95 |
|
96 |
Each separate quant is in a different branch. See below for instructions on fetching from different branches.
|
97 |
|
98 |
+
These GPTQs were made with Transformers.
|
99 |
|
100 |
<details>
|
101 |
<summary>Explanation of GPTQ parameters</summary>
|
|
|
193 |
|
194 |
Please make sure you're using the latest version of [text-generation-webui](https://github.com/oobabooga/text-generation-webui).
|
195 |
|
196 |
+
**NOTE** Will only work with `Loader: Transformers`, and requires `trust_remote_code=True`
|
197 |
+
|
198 |
It is strongly recommended to use the text-generation-webui one-click-installers unless you're sure you know how to make a manual install.
|
199 |
|
200 |
1. Click the **Model tab**.
|