Update README.md

README.md

@@ -1,45 +1,45 @@
----
-base_model:
-- KoboldAI/Mistral-7B-Holodeck-1
-- grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B
-library_name: transformers
-tags:
-- mergekit
-- merge
-license: apache-2.0
-pipeline_tag: text-generation
----
-# koboldai-holodeck-extended-32k-7B -7B
-
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
-
-Effective context length has been extended.
-
-## Merge Details
-### Merge Method
-
-This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B](https://huggingface.co/grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B) as a base.
-
-### Models Merged
-
-The following models were included in the merge:
-* [KoboldAI/Mistral-7B-Holodeck-1](https://huggingface.co/KoboldAI/Mistral-7B-Holodeck-1)
-
-### Configuration
-
-The following YAML configuration was used to produce this model:
-
-```yaml
-base_model: grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B
-dtype: bfloat16
-merge_method: task_arithmetic
-slices:
-- sources:
-  - layer_range: [0, 32]
-    model: grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B
-  - layer_range: [0, 32]
-    model: KoboldAI/Mistral-7B-Holodeck-1
-    parameters:
-      weight: 0.4
-
-```
+---
+base_model:
+- KoboldAI/Mistral-7B-Holodeck-1
+- grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: apache-2.0
+pipeline_tag: text-generation
+---
+# koboldai-holodeck-extended-32k-7B
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+Effective context length has been extended to at least 16k.
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B](https://huggingface.co/grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [KoboldAI/Mistral-7B-Holodeck-1](https://huggingface.co/KoboldAI/Mistral-7B-Holodeck-1)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B
+dtype: bfloat16
+merge_method: task_arithmetic
+slices:
+- sources:
+  - layer_range: [0, 32]
+    model: grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B
+  - layer_range: [0, 32]
+    model: KoboldAI/Mistral-7B-Holodeck-1
+    parameters:
+      weight: 0.4
+
+```