Hugging Face's logo

vihangd
/
smartsolmix-4x10.7b-v1

Text Generation
Transformers
Safetensors
mixtral
Merge
Mixture of Experts
text-generation-inference
Inference Endpoints
Model card Files Community
2
smartsolmix-4x10.7b-v1 / README.md
vihangd's picture
vihangd
Librarian Bot: Add moe tag to model (#1)
a0522e1
preview code
|
raw
history blame contribute delete
281 Bytes
metadata
license: cc-by-4.0
tags:
  - merge
  - moe

SmartSolMix-4x10.7b-v1

An experimental MOE of various 10.7b models made with mergekit

Experts

TBD

Prompt Template

Should work with chatml as well as alpaca style prompt templates