Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
f80b2f0
•
1 Parent(s): c67c46e

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00001-of-00009.gguf +3 -0
  3. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00002-of-00009.gguf +3 -0
  4. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00003-of-00009.gguf +3 -0
  5. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00004-of-00009.gguf +3 -0
  6. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00005-of-00009.gguf +3 -0
  7. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00006-of-00009.gguf +3 -0
  8. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00007-of-00009.gguf +3 -0
  9. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00008-of-00009.gguf +3 -0
  10. Q4_0/Mixtral-8x22B-v0.1-Q4_0-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -49,3 +49,12 @@ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00006-of-00009.gguf filter=l
49
  Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
50
  Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
51
  Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
49
  Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
50
  Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
51
  Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67c5521e3f017027ec57b0cb0d248546d5ef4e283a2657a484e1a0ba97db5945
3
+ size 615170752
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4283c26c682d093d50f46b1ec551da68d2055b4f4e4c7528c5c014937ab5e32
3
+ size 503959424
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d812c2d6c56d8e1fe2474f0dbf3f14074e610a7a8c816fd35996d5bc2776d5b1
3
+ size 510545792
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3077dc7236ec68abe6f8a06e71f8ae738d3a95c6d73043af1b3cc49345565e58
3
+ size 525094784
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f801fa82005953ba973687f24c3c4d3675d976f0a11ca26a73aeddbd4a4c296a
3
+ size 525094784
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d790ef49acb74920ad0cb92c94a12c9959e68245235a39fcf93e039af652bb2
3
+ size 510545792
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6558ae0b752ad9fb39a3573c15e08f21d3361e3fde51fc7775779a85d263be3a
3
+ size 24225538624
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2405a87dd02a688b8a9621363e32dc15e9c0e940511e6303fd98a5f2b3753505
3
+ size 28991034112
Q4_0/Mixtral-8x22B-v0.1-Q4_0-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cdaf5662785bec6090abe7f70b1ac7e1f5ddfe350cc5d87c995445f78f6e375
3
+ size 23102230336