Files changed (1) hide show
  1. README.md +3 -12
README.md CHANGED
@@ -120,18 +120,13 @@ Refer to the Provided Files table below to see what files use which methods, and
120
 
121
  **Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
122
 
123
- ### Q6_K and Q8_0 files are split and require joining
124
 
125
- **Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the Q6_K and Q8_0 files as split files.
126
 
127
  <details>
128
- <summary>Click for instructions regarding Q6_K and Q8_0 files</summary>
129
 
130
- ### q6_K
131
- Please download:
132
- * `mixtral_34bx2_moe_60b.Q6_K.gguf-split-a`
133
- * `mixtral_34bx2_moe_60b.Q6_K.gguf-split-b`
134
-
135
  ### q8_0
136
  Please download:
137
  * `mixtral_34bx2_moe_60b.Q8_0.gguf-split-a`
@@ -141,14 +136,10 @@ To join the files, do the following:
141
 
142
  Linux and macOS:
143
  ```
144
- cat mixtral_34bx2_moe_60b.Q6_K.gguf-split-* > mixtral_34bx2_moe_60b.Q6_K.gguf && rm mixtral_34bx2_moe_60b.Q6_K.gguf-split-*
145
  cat mixtral_34bx2_moe_60b.Q8_0.gguf-split-* > mixtral_34bx2_moe_60b.Q8_0.gguf && rm mixtral_34bx2_moe_60b.Q8_0.gguf-split-*
146
  ```
147
  Windows command line:
148
  ```
149
- COPY /B mixtral_34bx2_moe_60b.Q6_K.gguf-split-a + mixtral_34bx2_moe_60b.Q6_K.gguf-split-b mixtral_34bx2_moe_60b.Q6_K.gguf
150
- del mixtral_34bx2_moe_60b.Q6_K.gguf-split-a mixtral_34bx2_moe_60b.Q6_K.gguf-split-b
151
-
152
  COPY /B mixtral_34bx2_moe_60b.Q8_0.gguf-split-a + mixtral_34bx2_moe_60b.Q8_0.gguf-split-b mixtral_34bx2_moe_60b.Q8_0.gguf
153
  del mixtral_34bx2_moe_60b.Q8_0.gguf-split-a mixtral_34bx2_moe_60b.Q8_0.gguf-split-b
154
  ```
 
120
 
121
  **Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
122
 
123
+ ### Q8_0 files are split and require joining
124
 
125
+ **Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the Q8_0 files as split files.
126
 
127
  <details>
128
+ <summary>Click for instructions regarding Q8_0 files</summary>
129
 
 
 
 
 
 
130
  ### q8_0
131
  Please download:
132
  * `mixtral_34bx2_moe_60b.Q8_0.gguf-split-a`
 
136
 
137
  Linux and macOS:
138
  ```
 
139
  cat mixtral_34bx2_moe_60b.Q8_0.gguf-split-* > mixtral_34bx2_moe_60b.Q8_0.gguf && rm mixtral_34bx2_moe_60b.Q8_0.gguf-split-*
140
  ```
141
  Windows command line:
142
  ```
 
 
 
143
  COPY /B mixtral_34bx2_moe_60b.Q8_0.gguf-split-a + mixtral_34bx2_moe_60b.Q8_0.gguf-split-b mixtral_34bx2_moe_60b.Q8_0.gguf
144
  del mixtral_34bx2_moe_60b.Q8_0.gguf-split-a mixtral_34bx2_moe_60b.Q8_0.gguf-split-b
145
  ```