Hugging Face's logo

solidrust
/
MixtureofMerges-MoE-2x7b-SLERPv0.9b-AWQ

Text Generation
Transformers
Safetensors
mixtral
4-bit precision
AWQ
Inference Endpoints
Merge
mergekit
lazymergekit
zhengr/MixTAO-7Bx2-MoE-v8.1
jsfs11/MixtureofMerges-MoE-2x7b-v6
text-generation-inference
awq
Model card Files Community
Edit model card

jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b AWQ

Model Summary

MixtureofMerges-MoE-2x7b-SLERPv0.9b is a merge of the following models using LazyMergekit:

Downloads last month
9
Safetensors
Model size
1.95B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.

Model tree for solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9b-AWQ

Base model

jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b
Quantized
(1)
this model

Collection including solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9b-AWQ