Triangle104 commited on
Commit
2939c0c
1 Parent(s): 75d24ed

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -17,6 +17,23 @@ tags:
17
  This model was converted to GGUF format from [`nbeerbower/Llama3.1-Allades-8B`](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) for more details on the model.
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## Use with llama.cpp
21
  Install llama.cpp through brew (works on Mac and Linux)
22
 
 
17
  This model was converted to GGUF format from [`nbeerbower/Llama3.1-Allades-8B`](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
18
  Refer to the [original model card](https://huggingface.co/nbeerbower/Llama3.1-Allades-8B) for more details on the model.
19
 
20
+ ---
21
+ Allades finetunes abliterated Llama 3.1 with 5 datasets to improve creative writing, reasoning, and roleplay.
22
+ Datasets
23
+
24
+ jondurbin/gutenberg-dpo-v0.1
25
+ nbeerbower/gutenberg2-dpo
26
+ jondurbin/truthy-dpo-v0.1
27
+ kyujinpy/orca_math_dpo
28
+ antiven0m/physical-reasoning-dpo
29
+
30
+ Training
31
+
32
+ ORPO tuned for 1 epoch with 2x RTX 3090 (sponsored by Schneewolf Labs).
33
+
34
+ Data was prepared with Llama 3.1 Instruct.
35
+
36
+ ---
37
  ## Use with llama.cpp
38
  Install llama.cpp through brew (works on Mac and Linux)
39