jieunhan
/

solar_merge_test_1-1

Text Generation

Mixture of Experts

beomi/OPEN-SOLAR-KO-10.7B

hyeogi/SOLAR-10.7B-dpo-v1

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

solar_merge_test_1-1 / mergekit_moe_config.yml

jieunhan's picture

Upload folder using huggingface_hub

aeee795 verified 7 months ago

history blame contribute delete

380 Bytes


	base_model: beomi/OPEN-SOLAR-KO-10.7B
	dtype: float16
	experts:
	- source_model: beomi/OPEN-SOLAR-KO-10.7B
	positive_prompts: ["당신은 다방면으로 답변을 잘하는 어시스턴트이다."]
	- source_model: hyeogi/SOLAR-10.7B-dpo-v1
	positive_prompts: ["당신은 옳은 사실만을 말하는 어시스턴트이다."]
	gate_mode: cheap_embed
	tokenizer_source: base