Hugging Face's logo

RDson
/
Llama-3-Magenta-Instruct-4x8B-MoE-GGUF

GGUF
Mixture of Experts
llama
3
llama 3
2x8b
quantize
quant
Inference Endpoints
conversational
Model card Files Community
RDson commited on
Commit
e418c59
•
1 Parent(s): 721ca9c

Upload 2 files

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. Llama-3-Magenta-Instruct-4x8B-MoE-Q4_K_M.gguf +3 -0
  3. Llama-3-Magenta-Instruct-4x8B-MoE-Q5_K.gguf +3 -0
.gitattributes CHANGED
@@ -45,3 +45,5 @@ Llama-3-Magenta-Instruct-4x8B-MoE-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -tex
45
  Llama-3-Magenta-Instruct-4x8B-MoE-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
46
  Llama-3-Magenta-Instruct-4x8B-MoE-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
47
  Llama-3-Magenta-Instruct-4x8B-MoE-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
45
  Llama-3-Magenta-Instruct-4x8B-MoE-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
46
  Llama-3-Magenta-Instruct-4x8B-MoE-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
47
  Llama-3-Magenta-Instruct-4x8B-MoE-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Llama-3-Magenta-Instruct-4x8B-MoE-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Llama-3-Magenta-Instruct-4x8B-MoE-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-Magenta-Instruct-4x8B-MoE-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cd2346b3df6dc4a89b514f58d34a0ea0bad510e140ddc76d968ab4d3029dfd8
3
+ size 15161643616
Llama-3-Magenta-Instruct-4x8B-MoE-Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32fa4a1cf9a7a640062742e96d39e6e9504bbb2f44cd139f6a81acfdc92f3cdb
3
+ size 17735504480