Hugging Face's logo

gobean
/
Mixtral-8x7B-Instruct-v0.1-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
1
gobean commited on
Commit
3cd8e70
•
1 Parent(s): f6d5df3

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Mixtral-8x7B-Instruct-v0.1-q4-0.gguf +3 -0
  3. Mixtral-8x7B-Instruct-v0.1-q5-0.gguf +3 -0
  4. Mixtral-8x7B-Instruct-v0.1-q6-k.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Mixtral-8x7B-Instruct-v0.1-q3-k-m.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mixtral-8x7B-Instruct-v0.1-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
38
  Mixtral-8x7B-Instruct-v0.1-q5-k-m.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
36
  Mixtral-8x7B-Instruct-v0.1-q3-k-m.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mixtral-8x7B-Instruct-v0.1-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
38
  Mixtral-8x7B-Instruct-v0.1-q5-k-m.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mixtral-8x7B-Instruct-v0.1-q4-0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mixtral-8x7B-Instruct-v0.1-q5-0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mixtral-8x7B-Instruct-v0.1-q6-k.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x7B-Instruct-v0.1-q4-0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f68f28c845f7559252a76dad42413d80d7acaeb641f4d61938a4ba1897ef39b
3
+ size 26441492064
Mixtral-8x7B-Instruct-v0.1-q5-0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c51c8d9dabd9a6502c4fab41ac4cd181bb13456ac7ba4f653227b10b6b1513e1
3
+ size 32229238368
Mixtral-8x7B-Instruct-v0.1-q6-k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4b73d473a01c4d949ba3e0825dfa4ad7d5bafbea11a37a3c80063e9385844db
3
+ size 38378718816