maldv commited on
Commit
6095b57
1 Parent(s): 181703e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -24,6 +24,11 @@ datasets:
24
  - **Finetuned from model:** alpindale/Mistral-7B-v0.2-hf
25
  - **Methodology:** Simple newline delimited, rolling window book and stripped conversation data.
26
 
 
 
 
 
 
27
  ## Will It Write
28
 
29
  It's good. It goes page after page. It needs an authors note to stay on track though.
 
24
  - **Finetuned from model:** alpindale/Mistral-7B-v0.2-hf
25
  - **Methodology:** Simple newline delimited, rolling window book and stripped conversation data.
26
 
27
+ ## Have you learned anything?
28
+
29
+ Yes, I learned that if you try to train models that aren't the base model, that the results are trash. I have heard rumors that merging the LoRA's works,
30
+ which is why the companion LoRA for this is published as well.
31
+
32
  ## Will It Write
33
 
34
  It's good. It goes page after page. It needs an authors note to stay on track though.