Tinyllama-moe4 / mergekit_moe_config.yml
aipib's picture
Upload folder using huggingface_hub
5c0371b verified
raw
history blame
342 Bytes
base_model: vihangd/DopeyTinyLlama-1.1B-v1
experts:
- source_model: vihangd/DopeyTinyLlama-1.1B-v1
positive_prompts:
- "chat"
- "assistant"
- "tell me"
- "explain"
- source_model: gardner/TinyLlama-1.1B-Instruct-3T
positive_prompts:
- "reason"
- "provide"
- "instruct"
- "summarize"
- "count"