Triangle104 commited on
Commit
e7bb197
·
verified ·
1 Parent(s): 836bcc9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +66 -0
README.md CHANGED
@@ -15,6 +15,72 @@ language:
15
  This model was converted to GGUF format from [`allura-org/TQ2.5-14B-Aletheia-v1`](https://huggingface.co/allura-org/TQ2.5-14B-Aletheia-v1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
16
  Refer to the [original model card](https://huggingface.co/allura-org/TQ2.5-14B-Aletheia-v1) for more details on the model.
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  ## Use with llama.cpp
19
  Install llama.cpp through brew (works on Mac and Linux)
20
 
 
15
  This model was converted to GGUF format from [`allura-org/TQ2.5-14B-Aletheia-v1`](https://huggingface.co/allura-org/TQ2.5-14B-Aletheia-v1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
16
  Refer to the [original model card](https://huggingface.co/allura-org/TQ2.5-14B-Aletheia-v1) for more details on the model.
17
 
18
+ ---
19
+ Model details:
20
+ -
21
+ RP/Story hybrid model, merge of Sugarquill and Neon. As with Gemma version, I wanted to preserve Sugarquill's creative spark, while making the model more steerable for RP. It proved to be more difficult this time, but I quite like the result regardless, even if the model is still somewhat temperamental.
22
+
23
+ Should work for both RP and storywriting, either on raw completion or with back-and-forth cowriting in chat mode. Seems to be quite sensitive to low depth instructions and samplers.
24
+
25
+ Thanks to Toasty and Fizz for testing and giving feedback
26
+
27
+ Model was created by Auri.
28
+
29
+ Notes about merging
30
+ -
31
+ It took me 20 something attempts to make this model. TIES didn't work at all, producing broken or nearly broken results every time. SLERP worked much better and after just 3 attempts I got something I like. Sugarquill was really prone to overtaking the merge, so I had to reduce it's part a lot, and still model has a lot of influence from it.
32
+
33
+ Format
34
+ -
35
+ Model responds to ChatML instruct formatting, exactly like it's base model.
36
+
37
+ <|im_start|>system
38
+ {system message}<|im_end|>
39
+ <|im_start|>user
40
+ {user message}<|im_end|>
41
+ <|im_start|>assistant
42
+ {response}<|im_end|>
43
+
44
+ Recommended Samplers
45
+ -
46
+ This one is a bit of a special snowflake, with special tastes. Those seem to work pretty well:
47
+
48
+ Temperature - 0.8
49
+ Top-A - 0.3
50
+ TFS - 0.75
51
+ DRY - Multiplier 0.8 - Base 1.75 - Allowed length 3 - Range 1024
52
+
53
+ As a starting point, you can try this ST Master Import
54
+
55
+ Merge Method
56
+ -
57
+ This model was merged using the SLERP merge method.
58
+
59
+ Models Merged
60
+ -
61
+ The following models were included in the merge:
62
+
63
+ allura-org/TQ2.5-14B-Neon-v1
64
+ allura-org/TQ2.5-14B-Sugarquill-v1
65
+
66
+ Configuration
67
+ -
68
+ The following YAML configuration was used to produce this model:
69
+
70
+ base_model: allura-org/TQ2.5-14B-Sugarquill-v1
71
+ dtype: bfloat16
72
+ merge_method: slerp
73
+ parameters:
74
+ t:
75
+ - value: 0.7
76
+ slices:
77
+ - sources:
78
+ - layer_range: [0, 48]
79
+ model: allura-org/TQ2.5-14B-Neon-v1
80
+ - layer_range: [0, 48]
81
+ model: allura-org/TQ2.5-14B-Sugarquill-v1
82
+
83
+ ---
84
  ## Use with llama.cpp
85
  Install llama.cpp through brew (works on Mac and Linux)
86