Upload README.md
Browse files
README.md
CHANGED
@@ -119,7 +119,7 @@ Refer to the Provided Files table below to see what files use which methods, and
|
|
119 |
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|
120 |
| ---- | ---- | ---- | ---- | ---- | ----- |
|
121 |
| [starling-lm-7b-alpha.Q2_K.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q2_K.gguf) | Q2_K | 2 | 3.08 GB| 5.58 GB | smallest, significant quality loss - not recommended for most purposes |
|
122 |
-
| [starling-lm-7b-alpha.Q3_K_S.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q3_K_S.gguf) | Q3_K_S | 3 | 3.
|
123 |
| [starling-lm-7b-alpha.Q3_K_M.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q3_K_M.gguf) | Q3_K_M | 3 | 3.52 GB| 6.02 GB | very small, high quality loss |
|
124 |
| [starling-lm-7b-alpha.Q3_K_L.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q3_K_L.gguf) | Q3_K_L | 3 | 3.82 GB| 6.32 GB | small, substantial quality loss |
|
125 |
| [starling-lm-7b-alpha.Q4_0.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q4_0.gguf) | Q4_0 | 4 | 4.11 GB| 6.61 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
|
|
|
119 |
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|
120 |
| ---- | ---- | ---- | ---- | ---- | ----- |
|
121 |
| [starling-lm-7b-alpha.Q2_K.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q2_K.gguf) | Q2_K | 2 | 3.08 GB| 5.58 GB | smallest, significant quality loss - not recommended for most purposes |
|
122 |
+
| [starling-lm-7b-alpha.Q3_K_S.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q3_K_S.gguf) | Q3_K_S | 3 | 3.16 GB| 5.66 GB | very small, high quality loss |
|
123 |
| [starling-lm-7b-alpha.Q3_K_M.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q3_K_M.gguf) | Q3_K_M | 3 | 3.52 GB| 6.02 GB | very small, high quality loss |
|
124 |
| [starling-lm-7b-alpha.Q3_K_L.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q3_K_L.gguf) | Q3_K_L | 3 | 3.82 GB| 6.32 GB | small, substantial quality loss |
|
125 |
| [starling-lm-7b-alpha.Q4_0.gguf](https://huggingface.co/TheBloke/Starling-LM-7B-alpha-GGUF/blob/main/starling-lm-7b-alpha.Q4_0.gguf) | Q4_0 | 4 | 4.11 GB| 6.61 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
|