Hugging Face's logo

MaziyarPanahi
/
WizardLM-2-8x22B-GGUF

Text Generation
Transformers
GGUF
Safetensors
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mistral
arxiv:2304.12244
arxiv:2306.08568
arxiv:2308.09583
Inference Endpoints
text-generation-inference
Model card Files Community
15
MaziyarPanahi commited on
Commit
4a6e8ed
•
1 Parent(s): 1ac430a

Upload folder using huggingface_hub (#3)

Browse files

- 1114a1eb451a44402b95257eae4bd1fe8767c3c4b5db4a6e436873d7b51cc058 (61cc39cc991c9e601c3277d23201609ad42ba389)
- e2c60877f2c7e7cf7f84010c5d5477881fa32d2f0f77897b50bb8b9e37ab9a2f (a14cab15cc414988c2db1221a954251e8dd46dc2)
- 97e7b6b35a59881308728bd50269012bd91f0ee0e3f0662cdc8f8d7723c66042 (8dcd92f86a66c918ae018c5f7d2a995eab35d460)
- e7c6fa2732f6549be122108604dd8d35356f92e8484a9e24fd53a660d9f18210 (6984ebaa7f720df2c8ebb7cce91f14d50f77d4f9)
- 7fb1cd723258b12b200de180d05fc0b1832a55097b056ee4cdf472a734e55c9b (f3be185c78349801294c5c6f359e13a296892709)
- 45f8495569694129e8cedf3a215a81334a0e757b45d4203f1ea6fc64ecab3083 (cb1d10b8f3a53f84884172efad2251187435b062)
- 917d3ee651178c19c509a4361775f1cad6a2219f2cc4573075a932dd50df51ef (755ea2d4157337a1d3e48de25c727c8bc69fc321)
- fed7340e4da126b5695b1226325dc3d26daccf4bcd95d4455719a760d2e51579 (fafd1e6fd689802db9b5ff5cf8d2a853b4e21d9b)
- c2b4f2c52535109a6f40614b6d3103aa57d515de0d94765f5b97736bf0bb3026 (2a3c5478846a2533b07da0d166e4cfeadcccf12f)
- 88b8f248dfc18d4af10bb9854ca5516e406d9c5208616aee9a6a86e39bfa0fd0 (56c1c0559b1eb618899724f25e5017631c638e61)

Files changed (11) hide show
  1. .gitattributes +10 -0
  2. WizardLM-2-8x22B.IQ3_XS-00001-of-00005.gguf +3 -0
  3. WizardLM-2-8x22B.IQ3_XS-00002-of-00005.gguf +3 -0
  4. WizardLM-2-8x22B.IQ3_XS-00003-of-00005.gguf +3 -0
  5. WizardLM-2-8x22B.IQ3_XS-00004-of-00005.gguf +3 -0
  6. WizardLM-2-8x22B.IQ3_XS-00005-of-00005.gguf +3 -0
  7. WizardLM-2-8x22B.Q3_K_S-00001-of-00005.gguf +3 -0
  8. WizardLM-2-8x22B.Q3_K_S-00002-of-00005.gguf +3 -0
  9. WizardLM-2-8x22B.Q3_K_S-00003-of-00005.gguf +3 -0
  10. WizardLM-2-8x22B.Q3_K_S-00004-of-00005.gguf +3 -0
  11. WizardLM-2-8x22B.Q3_K_S-00005-of-00005.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,13 @@ WizardLM-2-8x22B.Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
38
  WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
38
  WizardLM-2-8x22B.Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  WizardLM-2-8x22B.Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  WizardLM-2-8x22B.Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
+ WizardLM-2-8x22B.IQ3_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
42
+ WizardLM-2-8x22B.IQ3_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
43
+ WizardLM-2-8x22B.IQ3_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
44
+ WizardLM-2-8x22B.IQ3_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
45
+ WizardLM-2-8x22B.IQ3_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
46
+ WizardLM-2-8x22B.Q3_K_S-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
47
+ WizardLM-2-8x22B.Q3_K_S-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
48
+ WizardLM-2-8x22B.Q3_K_S-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
49
+ WizardLM-2-8x22B.Q3_K_S-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
50
+ WizardLM-2-8x22B.Q3_K_S-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
WizardLM-2-8x22B.IQ3_XS-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:507606f84c52f2f3e73985fa7717f491a9a6a1328d4650d023ebecaef8033614
3
+ size 13520020416
WizardLM-2-8x22B.IQ3_XS-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e566a04d762cddc4579b844e425c614b46e2266756e7255e99d03bd93c3144e
3
+ size 13483630784
WizardLM-2-8x22B.IQ3_XS-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fafb55b1e73da0c6ababd35b4086578f0c29b1a04b5492ad3e3475660f85ddab
3
+ size 12270264448
WizardLM-2-8x22B.IQ3_XS-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e421a93a1fcbd9ff769cc5eed1e74b8c3ab281ecdc7977f915c6929ffa9859b7
3
+ size 13339615392
WizardLM-2-8x22B.IQ3_XS-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37afb9affd4192da35e6d4e4879a79571457b1d2b2d358f5ab269978c1bc506c
3
+ size 5614673216
WizardLM-2-8x22B.Q3_K_S-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02c67f83658f8039c146642741936c7a1ad18d786af0364e7486f616c45508fc
3
+ size 13958259648
WizardLM-2-8x22B.Q3_K_S-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4578f7ef6150c93b7347bdb77c6f2c3f839bec145ec9022bccea8900d8e3caf2
3
+ size 14525849792
WizardLM-2-8x22B.Q3_K_S-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbf516d44516ac5f1478f48dfb37c45ebd91940111b32af93edbcf629441e8a5
3
+ size 13197467776
WizardLM-2-8x22B.Q3_K_S-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f4433ced22748b00fabffe18ef41b93aa164214029603286ecc55ad7ef6f8e1
3
+ size 14193090720
WizardLM-2-8x22B.Q3_K_S-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13b984ca43dcbf4d0a873d7658400060ab00629cc784716142819dbb045da01c
3
+ size 5623520576