shaowenchen
/

vicuna-33b-v1.3-gguf

Text Generation

Model card Files Files and versions Community

shaowenchen commited on Sep 13, 2023

Commit

c373397

•

1 Parent(s): c2e1b2f

improvement: readme

Files changed (1) hide show

README.md +24 -17

README.md CHANGED Viewed

@@ -19,23 +19,30 @@ tags:
 ## Provided files
-| Name                        | Quant method | Size  |
-| --------------------------- | ------------ | ----- |
-| vicuna-33b-v1.3.Q2_K.gguf   | Q2_K         | 13 GB |
-| vicuna-33b-v1.3.Q3_K.gguf   | Q3_K         | 15 GB |
-| vicuna-33b-v1.3.Q3_K_L.gguf | Q3_K_L       | 16 GB |
-| vicuna-33b-v1.3.Q3_K_S.gguf | Q3_K_S       | 13 GB |
-| vicuna-33b-v1.3.Q4_0.gguf   | Q4_0         | 17 GB |
-| vicuna-33b-v1.3.Q4_1.gguf   | Q4_1         | 19 GB |
-| vicuna-33b-v1.3.Q4_K.gguf   | Q4_K         | 18 GB |
-| vicuna-33b-v1.3.Q4_K_S.gguf | Q4_K_S       | 17 GB |
-| vicuna-33b-v1.3.Q5_0.gguf   | Q5_0         | 21 GB |
-| vicuna-33b-v1.3.Q5_1.gguf   | Q5_1         | 23 GB |
-| vicuna-33b-v1.3.Q5_K.gguf   | Q5_K         | 21 GB |
-| vicuna-33b-v1.3.Q5_K_S.gguf | Q5_K_S       | 21 GB |
-| vicuna-33b-v1.3.Q6_K.gguf   | Q6_K         | 25 GB |
-| vicuna-33b-v1.3.Q8_0.gguf   | Q8_0         | 32 GB |
-| vicuna-33b-v1.3.gguf        | full         | 61 GB |
 Usage:

 ## Provided files
+| Name                          | Quant method | Size  |
+| ----------------------------- | ------------ | ----- |
+| vicuna-33b-v1.3.Q2_K.gguf     | Q2_K         | 13 GB |
+| vicuna-33b-v1.3.Q3_K.gguf     | Q3_K         | 15 GB |
+| vicuna-33b-v1.3.Q3_K_L.gguf   | Q3_K_L       | 16 GB |
+| vicuna-33b-v1.3.Q3_K_S.gguf   | Q3_K_S       | 13 GB |
+| vicuna-33b-v1.3.Q4_0.gguf     | Q4_0         | 17 GB |
+| vicuna-33b-v1.3.Q4_1.gguf     | Q4_1         | 19 GB |
+| vicuna-33b-v1.3.Q4_K.gguf     | Q4_K         | 18 GB |
+| vicuna-33b-v1.3.Q4_K_S.gguf   | Q4_K_S       | 17 GB |
+| vicuna-33b-v1.3.Q5_0.gguf     | Q5_0         | 21 GB |
+| vicuna-33b-v1.3.Q5_1.gguf     | Q5_1         | 23 GB |
+| vicuna-33b-v1.3.Q5_K.gguf     | Q5_K         | 21 GB |
+| vicuna-33b-v1.3.Q5_K_S.gguf   | Q5_K_S       | 21 GB |
+| vicuna-33b-v1.3.Q6_K.gguf     | Q6_K         | 25 GB |
+| vicuna-33b-v1.3.Q8_0.gguf     | Q8_0         | 32 GB |
+| vicuna-33b-v1.3.gguf-split-aa | full         | 31 GB |
+| vicuna-33b-v1.3.gguf-split-ab | full         | 30 GB |
+How to merge the split files:
+```
+cat vicuna-33b-v1.3.gguf-split-* > vicuna-33b-v1.3.gguf && rm vicuna-33b-v1.3.gguf-split-*
+```
 Usage: