Henk717 commited on
Commit
1ba2061
1 Parent(s): 148ccc6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -2
README.md CHANGED
@@ -1,5 +1,40 @@
1
  ---
2
  license: other
3
- license_name: origin
4
- license_link: LICENSE
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
 
 
3
  ---
4
+
5
+ A product of an amateur merger. I like it due to the fact that it combines both Orca2 understanding and Pyg's dialogue style (using mythalion for consistency). - shotmisser64
6
+
7
+ This model was made by ShotMisser64 using the following mergekit yaml:
8
+ ```
9
+ slices:
10
+ - sources:
11
+ - model: output/Orca2flat
12
+ layer_range: [0, 13]
13
+ - sources:
14
+ - model: PygmalionAI/mythalion-13b
15
+ layer_range: [3, 22]
16
+ - sources:
17
+ - model: output/Orca2flat
18
+ layer_range: [14, 27]
19
+ - sources:
20
+ - model: PygmalionAI/mythalion-13b
21
+ layer_range: [23, 40]
22
+ merge_method: passthrough
23
+ dtype: float16
24
+ ```
25
+
26
+ The Orca2flat model uses the following mergekit yaml:
27
+ ```
28
+ merge_method: task_arithmetic
29
+ base_model: TheBloke/Llama-2-13B-fp16
30
+ models:
31
+ - model: TheBloke/Llama-2-13B-fp16
32
+ - model: microsoft/Orca-2-13b
33
+ parameters:
34
+ weight: 1.0
35
+ dtype: float16
36
+ ```
37
+
38
+ Found something interesting or would you like your own custom merge? Visit our community at https://koboldai.org/discord
39
+
40
+ Please respect the license of the origin models.