Aryanne commited on
Commit
697e0b8
1 Parent(s): 8748b76

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -1 +1,31 @@
1
- more info soon
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: transformers
5
+ tags:
6
+ - gpt
7
+ - llm
8
+ - large language model
9
+ inference: true
10
+ license: cc-by-sa-4.0
11
+ ---
12
+ This model is a merge of [euclaise/Echo-3B](https://huggingface.co/euclaise/Echo-3B), [stabilityai/stablelm-zephyr-3b](https://huggingface.co/stabilityai/stablelm-zephyr-3b) and [Aryanne/Astridboros-3B](https://huggingface.co/Aryanne/Astridboros-3B) using task_arithmetic(see astrea-rp-v1-3b.yml or below).
13
+
14
+
15
+ ```yaml
16
+ merge_method: task_arithmetic
17
+ base_model: euclaise/Ferret-3B
18
+ models:
19
+ - model: euclaise/Ferret-3B
20
+ - model: stabilityai/stablelm-zephyr-3b
21
+ parameters:
22
+ weight: 0.33
23
+ - model: euclaise/Echo-3B
24
+ parameters:
25
+ weight: 0.66
26
+ - model: Aryanne/Astridboros-3B
27
+ parameters:
28
+ weight: 0.16
29
+ dtype: float16
30
+ ```
31
+ I recommend the use of Vicuna prompt format, but it's your choice to see what works for you.