Hugging Face's logo

LiteLLMs
/
WizardLM-2-8x22B-GGUF

GGUF
GGUF
Inference Endpoints
conversational
Model card Files Community
andrijdavid commited on
Commit
76e120e
•
1 Parent(s): c014bb6

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +9 -0
  2. Q5_0/Q5_0-00001-of-00009.gguf +3 -0
  3. Q5_0/Q5_0-00002-of-00009.gguf +3 -0
  4. Q5_0/Q5_0-00003-of-00009.gguf +3 -0
  5. Q5_0/Q5_0-00004-of-00009.gguf +3 -0
  6. Q5_0/Q5_0-00005-of-00009.gguf +3 -0
  7. Q5_0/Q5_0-00006-of-00009.gguf +3 -0
  8. Q5_0/Q5_0-00007-of-00009.gguf +3 -0
  9. Q5_0/Q5_0-00008-of-00009.gguf +3 -0
  10. Q5_0/Q5_0-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -51,3 +51,12 @@ Q4_1/Q4_1-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
51
  Q4_1/Q4_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
52
  Q4_1/Q4_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
53
  Q4_1/Q4_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
51
  Q4_1/Q4_1-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
52
  Q4_1/Q4_1-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
53
  Q4_1/Q4_1-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Q5_0/Q5_0-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Q5_0/Q5_0-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Q5_0/Q5_0-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Q5_0/Q5_0-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Q5_0/Q5_0-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Q5_0/Q5_0-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Q5_0/Q5_0-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Q5_0/Q5_0-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
62
+ Q5_0/Q5_0-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Q5_0/Q5_0-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33669e31c047ced6dd41520f39f624cf5fb7c23ba15155102beb175f4b875d51
3
+ size 724682272
Q5_0/Q5_0-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ab37dc236928b9d0f2c788838a02e55b49c0791ce48f7aa25c37c2f12295046
3
+ size 588894080
Q5_0/Q5_0-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f76c932b9f2fc210dbfc6b01b07d010d9d22f5124c602f35256ef08a91dde545
3
+ size 595480448
Q5_0/Q5_0-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be0c1dc9e055904a78840dd6c85265205208e9d8f9051541be93caeff4ef0346
3
+ size 614748032
Q5_0/Q5_0-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bba620c5a1f73858e31459ec7756f96ea240a3c21ee029a5c66b472a327e9386
3
+ size 614748032
Q5_0/Q5_0-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:860ba05dd555af964bb0660945e4d9117756fd0bee288069a8cb55703d4f88ad
3
+ size 595480448
Q5_0/Q5_0-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbea86c0f9b5d06214c14cbee6d0c8a793e25ab536adce97fdc206347db66d4e
3
+ size 29570130496
Q5_0/Q5_0-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3232af5b9a8bdf721dbbd10cb0e07d23a35d3524571a93cd48664451db6f928e
3
+ size 35433485056
Q5_0/Q5_0-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d3752a28e66f35d393a19bec14eb1fc03a3cf15240f5a20581144d04d8519d5
3
+ size 28236058432