Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
0f29117
•
1 Parent(s): 55e36b4

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00009.gguf +3 -0
  3. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00002-of-00009.gguf +3 -0
  4. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00003-of-00009.gguf +3 -0
  5. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00004-of-00009.gguf +3 -0
  6. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00005-of-00009.gguf +3 -0
  7. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00006-of-00009.gguf +3 -0
  8. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00007-of-00009.gguf +3 -0
  9. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00008-of-00009.gguf +3 -0
  10. Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -76,3 +76,12 @@ Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00006-of-00009.gguf filter=lfs diff=lfs merge=l
76
  Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
  Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
  Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
76
  Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
77
  Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
78
  Q3_K_S/Mixtral-8x22B-v0.1-Q3_K_S-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
79
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
80
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
81
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
82
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
83
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
84
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
85
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
86
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
87
+ Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bd665d5676ce78f4d726571ef3f8d5a2ae57066c10c5bc59cdd00dd36e2c875
3
+ size 586404544
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8d0c3880f69b7f0db95573b92fb3f3554cf03acc33b8c1b4966999101667cde
3
+ size 501305216
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c650f248c7dd58a379f041d8415d7013b63e5de4a3773b4111b9dda811bdb2f3
3
+ size 507891584
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d19badeb7243c49337c15c56c58190ac6c4216d2a1dce5bd172ad68ea584967
3
+ size 527159168
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af3bfbc51868806d028f004d14e995feb4055f4c18afc70372db051987db341d
3
+ size 517427072
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7eec15d53ee90f39df008bde6b4632a9ded544792bfe2b2f11bf067b0bc9eaa
3
+ size 507891584
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e42c4dfa8f54fd3f0b59d76f27f49557844440dda1bce33ff65e10c95d2703d
3
+ size 20783817280
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bc5c845ebaff5aeb0aaa537832d717cda4e6b85914ad1a143e0e3e847f98445
3
+ size 24391979776
Q3_K_M/Mixtral-8x22B-v0.1-Q3_K_M-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c3ae1737ed827c022b45eb6ebc977831b528c07e16f0cb12189ed90df5f3373
3
+ size 19465768768