TheBloke commited on
Commit
ed93930
1 Parent(s): 5b6d1be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -48,6 +48,8 @@ tags:
48
 
49
  This repo contains GPTQ model files for [Microsoft's Phi 2](https://huggingface.co/microsoft/phi-2).
50
 
 
 
51
  Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
52
 
53
  <!-- description end -->
@@ -93,7 +95,7 @@ Multiple quantisation parameters are provided, to allow you to choose the best o
93
 
94
  Each separate quant is in a different branch. See below for instructions on fetching from different branches.
95
 
96
- Most GPTQ files are made with AutoGPTQ. Mistral models are currently made with Transformers.
97
 
98
  <details>
99
  <summary>Explanation of GPTQ parameters</summary>
@@ -191,6 +193,8 @@ Note that using Git with HF repos is strongly discouraged. It will be much slowe
191
 
192
  Please make sure you're using the latest version of [text-generation-webui](https://github.com/oobabooga/text-generation-webui).
193
 
 
 
194
  It is strongly recommended to use the text-generation-webui one-click-installers unless you're sure you know how to make a manual install.
195
 
196
  1. Click the **Model tab**.
 
48
 
49
  This repo contains GPTQ model files for [Microsoft's Phi 2](https://huggingface.co/microsoft/phi-2).
50
 
51
+ **NOTE** These GPTQs will only work with Transformers, and require `trust_remote_code=True`.
52
+
53
  Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
54
 
55
  <!-- description end -->
 
95
 
96
  Each separate quant is in a different branch. See below for instructions on fetching from different branches.
97
 
98
+ These GPTQs were made with Transformers.
99
 
100
  <details>
101
  <summary>Explanation of GPTQ parameters</summary>
 
193
 
194
  Please make sure you're using the latest version of [text-generation-webui](https://github.com/oobabooga/text-generation-webui).
195
 
196
+ **NOTE** Will only work with `Loader: Transformers`, and requires `trust_remote_code=True`
197
+
198
  It is strongly recommended to use the text-generation-webui one-click-installers unless you're sure you know how to make a manual install.
199
 
200
  1. Click the **Model tab**.