Create README.md

README.md

@@ -0,0 +1,80 @@
+---
+base_model:
+- migtissera/Tess-70B-v1.6
+- 152334H/miqu-1-70b-sf
+- NeverSleep/MiquMaid-v2-70B
+- sophosympatheia/Midnight-Miqu-70B-v1.0
+library_name: transformers
+tags:
+- mergekit
+- merge
+
+---
+# Miqu-MS-70B
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+The new MODEL STOCK merge method was used, see below for more information!
+
+Feedback on this model is greatly appreciated! I hope this new merge method will be able to fill some hole Miqu have.
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [migtissera/Tess-70B-v1.6](https://huggingface.co/migtissera/Tess-70B-v1.6)
+* [NeverSleep/MiquMaid-v2-70B](https://huggingface.co/NeverSleep/MiquMaid-v2-70B)
+* [sophosympatheia/Midnight-Miqu-70B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: NeverSleep/MiquMaid-v2-70B
+  - model: sophosympatheia/Midnight-Miqu-70B-v1.0
+  - model: migtissera/Tess-70B-v1.6
+  - model: 152334H/miqu-1-70b-sf
+merge_method: model_stock
+base_model: 152334H/miqu-1-70b-sf
+dtype: bfloat16
+```
+### Prompt format
+
+Since it was made with model using different prompt format, the following should work.
+
+## Alpaca
+
+```
+### Instruction:
+{system prompt}
+
+### Input:
+{prompt}
+
+### Response:
+{output}
+```
+
+## Mistral
+
+```
+[INST] {prompt} [/INST] 
+```
+
+## Vicuna
+
+```
+SYSTEM: <ANY SYSTEM CONTEXT>
+USER: 
+ASSISTANT:
+```
+
+### Support
+
+If you want to support me, you can [here](https://ko-fi.com/undiai).