Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
8b1bf9c
•
1 Parent(s): f80b2f0

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00001-of-00009.gguf +3 -0
  3. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00002-of-00009.gguf +3 -0
  4. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00003-of-00009.gguf +3 -0
  5. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00004-of-00009.gguf +3 -0
  6. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00005-of-00009.gguf +3 -0
  7. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00006-of-00009.gguf +3 -0
  8. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00007-of-00009.gguf +3 -0
  9. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00008-of-00009.gguf +3 -0
  10. Q2_K/Mixtral-8x22B-v0.1-Q2_K-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -58,3 +58,12 @@ Q4_0/Mixtral-8x22B-v0.1-Q4_0-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -
58
  Q4_0/Mixtral-8x22B-v0.1-Q4_0-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
59
  Q4_0/Mixtral-8x22B-v0.1-Q4_0-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
60
  Q4_0/Mixtral-8x22B-v0.1-Q4_0-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
58
  Q4_0/Mixtral-8x22B-v0.1-Q4_0-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
59
  Q4_0/Mixtral-8x22B-v0.1-Q4_0-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
60
  Q4_0/Mixtral-8x22B-v0.1-Q4_0-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
62
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Q2_K/Mixtral-8x22B-v0.1-Q2_K-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:856dfdafd49d380acd9f9a0c6e35dcebe3ec559a9bcae9b99807eedf5e54da6d
3
+ size 531931840
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8afe78c3bc7f6712fef9b2d487e291960af17d6c791de02458a9464fd9a9f0b0
3
+ size 466800512
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f9ffffcacc9961727d119d30efbda7fd1c3161fb60016d9fbb111672822c896
3
+ size 473386880
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:689b7ce8ce24e1118848fa83894131344f4b5cc356afeeeb5f66ca8c4c91fd2f
3
+ size 492654464
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:259d6df1f9ad3cdc2324a712d951bb33d5b43c982ec4fbb3979ddafeac323fc9
3
+ size 479088512
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1479e23d05b1d5595eb7032ac3fb23c45193cb40d7e3e64172c643255bee116c
3
+ size 473386880
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55ec002dd891b5706a98df2f19fd8d8c9f6c6ca31b90dadc7ad2fde37ed87a15
3
+ size 15690195520
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:975b735b2ade149d9710ea932e45c073b3318a4bfa2de856ff7143745d8711e4
3
+ size 18629006080
Q2_K/Mixtral-8x22B-v0.1-Q2_K-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1d0a0465dfe5b20ab565e691767b6093897fb541f3114dda2284ab9f90fe5f9
3
+ size 14866714432