Undi95 commited on
Commit
65e9fc7
1 Parent(s): 2b1a5ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -2
README.md CHANGED
@@ -1,5 +1,33 @@
1
- This is a test
 
 
 
 
 
2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ### Custom format:
4
  ```
5
  ### Instruction:
@@ -10,4 +38,6 @@ This is a test
10
 
11
  ### Response:
12
  {reply}
13
- ```
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
+ - nsfw
6
+ ---
7
 
8
+ First experimental merge of Noromaid 8x7b (Instruct) and dolphin 8x7b. The idea behind this is to add a little more IQ to the model, because Noromaid was only trained on RP/ERP data. Dolphin 2.7 is the only real Mixtral finetune I consider "usable", and so the merging quest begin again kek.
9
+
10
+ Merged Dolphin 2.7 with Mixtral Base (Dolphin was at 1.0 weight) to get rid of ChatLM, and then I merged Noromaid 8x7b with the output, SLERP method.
11
+
12
+ This model feel better on the IQ chart and have the ~same average score than Noromaid 8x7b, but it's softer and more prude too, it also have the typical Mixtral repeat issue at some point. Choose your poison.
13
+
14
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/uZlU0PEPtKPZPLzXcoqJ_.png)
15
+
16
+ <!-- description start -->
17
+ ## Description
18
+
19
+ This repo contains fp16 files of FlatDolphinMaid-8x7B.
20
+
21
+ <!-- description end -->
22
+ <!-- description start -->
23
+ ## Models used
24
+
25
+ - [mistralai/Mixtral-8x7B-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1)
26
+ - [cognitivecomputations/dolphin-2.7-mixtral-8x7b](https://huggingface.co/cognitivecomputations/dolphin-2.7-mixtral-8x7b)
27
+ - [NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3](https://huggingface.co/NeverSleep/Noromaid-v0.1-mixtral-8x7b-Instruct-v3)
28
+
29
+ <!-- description end -->
30
+ <!-- prompt-template start -->
31
  ### Custom format:
32
  ```
33
  ### Instruction:
 
38
 
39
  ### Response:
40
  {reply}
41
+ ```
42
+
43
+ If you want to support me, you can [here](https://ko-fi.com/undiai).