Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,40 @@
|
|
1 |
---
|
2 |
license: other
|
3 |
-
license_name: origin
|
4 |
-
license_link: LICENSE
|
5 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: other
|
|
|
|
|
3 |
---
|
4 |
+
|
5 |
+
A product of an amateur merger. I like it due to the fact that it combines both Orca2 understanding and Pyg's dialogue style (using mythalion for consistency). - shotmisser64
|
6 |
+
|
7 |
+
This model was made by ShotMisser64 using the following mergekit yaml:
|
8 |
+
```
|
9 |
+
slices:
|
10 |
+
- sources:
|
11 |
+
- model: output/Orca2flat
|
12 |
+
layer_range: [0, 13]
|
13 |
+
- sources:
|
14 |
+
- model: PygmalionAI/mythalion-13b
|
15 |
+
layer_range: [3, 22]
|
16 |
+
- sources:
|
17 |
+
- model: output/Orca2flat
|
18 |
+
layer_range: [14, 27]
|
19 |
+
- sources:
|
20 |
+
- model: PygmalionAI/mythalion-13b
|
21 |
+
layer_range: [23, 40]
|
22 |
+
merge_method: passthrough
|
23 |
+
dtype: float16
|
24 |
+
```
|
25 |
+
|
26 |
+
The Orca2flat model uses the following mergekit yaml:
|
27 |
+
```
|
28 |
+
merge_method: task_arithmetic
|
29 |
+
base_model: TheBloke/Llama-2-13B-fp16
|
30 |
+
models:
|
31 |
+
- model: TheBloke/Llama-2-13B-fp16
|
32 |
+
- model: microsoft/Orca-2-13b
|
33 |
+
parameters:
|
34 |
+
weight: 1.0
|
35 |
+
dtype: float16
|
36 |
+
```
|
37 |
+
|
38 |
+
Found something interesting or would you like your own custom merge? Visit our community at https://koboldai.org/discord
|
39 |
+
|
40 |
+
Please respect the license of the origin models.
|