saishf commited on
Commit
b9f6415
1 Parent(s): 6dfc742

Upload 6 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Top-Western-Maid-7B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Top-Western-Maid-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Top-Western-Maid-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Top-Western-Maid-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Top-Western-Maid-7B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - NeverSleep/Noromaid-7B-0.4-DPO
4
+ - Undi95/Toppy-M-7B
5
+ - mistralai/Mistral-7B-v0.1
6
+ - senseable/WestLake-7B-v2
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+
11
+ ---
12
+ # merge
13
+
14
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
+
16
+ ## Merge Details
17
+ ### Merge Method
18
+
19
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base.
20
+
21
+ ### Models Merged
22
+
23
+ The following models were included in the merge:
24
+ * [NeverSleep/Noromaid-7B-0.4-DPO](https://huggingface.co/NeverSleep/Noromaid-7B-0.4-DPO)
25
+ * [Undi95/Toppy-M-7B](https://huggingface.co/Undi95/Toppy-M-7B)
26
+ * [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2)
27
+
28
+ ### Configuration
29
+
30
+ The following YAML configuration was used to produce this model:
31
+
32
+ ```yaml
33
+ models:
34
+ - model: mistralai/Mistral-7B-v0.1
35
+ # No parameters necessary for base model
36
+ - model: senseable/WestLake-7B-v2
37
+ parameters:
38
+ density: 0.53
39
+ weight: 0.55
40
+ - model: NeverSleep/Noromaid-7B-0.4-DPO
41
+ parameters:
42
+ density: 0.53
43
+ weight: 0.30
44
+ - model: Undi95/Toppy-M-7B
45
+ parameters:
46
+ density: 0.53
47
+ weight: 0.15
48
+ merge_method: dare_ties
49
+ base_model: mistralai/Mistral-7B-v0.1
50
+ parameters:
51
+ int8_mask: true
52
+ dtype: bfloat16
53
+
54
+ ```
Top-Western-Maid-7B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22f0ab612b3c373c07a4bd117d48c5b71b17484c384790b888e3492f72277b6c
3
+ size 2719241920
Top-Western-Maid-7B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:333e75bcfda2939a41e67ef8d619e493ee44fa1dba64ea314429df967c1375c5
3
+ size 3518985920
Top-Western-Maid-7B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:454b7687c51a593ee0e1e39c2dcd769df5a2cc60af2701ca3a14e6a2cc06f091
3
+ size 4368438976
Top-Western-Maid-7B-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67807dcc054c20b897b290d9ebbc4fb0b66f11dd49a8663b99189a42286b3e38
3
+ size 5131409088
Top-Western-Maid-7B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52f26591d3c8c32650d976788a19157ba16c6f6f3eb572e463862c24b7b96f81
3
+ size 5942064832