AIChenKai
/

TinyLlama-1.1B-Chat-v1.0-x2-MoE

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

AIChenKai commited on Jan 3

Commit

0b106bf

•

1 Parent(s): 71fa042

Update README.md

Files changed (1) hide show

README.md +12 -0

README.md CHANGED Viewed

@@ -1,3 +1,15 @@
 ---
 license: apache-2.0
 ---

 ---
 license: apache-2.0
 ---
+Config:
+'''
+base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
+gate_mode: hidden
+dtype: bfloat16
+experts:
+  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
+    positive_prompts: [""]
+  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
+    positive_prompts: [""]
+'''