Update README.md
Browse files
README.md
CHANGED
@@ -21,13 +21,11 @@ quantized_by: dfurman
|
|
21 |
|
22 |
# dfurman/CalmeRys-78B-Orpo-v0.1
|
23 |
|
24 |
-
This model is a finetune of `MaziyarPanahi/calme-2.4-rys-78b` on 1.5k rows of the `mlabonne/orpo-dpo-mix-40k` dataset.
|
25 |
-
|
26 |
-
It was trained as a generalist language model for a variety of text generation use cases, including support of agentic capabilities, roleplaying, reasoning, multi-turn conversations, long context coherence, and more.
|
27 |
|
28 |
## 🦾 Training
|
29 |
|
30 |
-
Here are a few visualizations
|
31 |
|
32 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62afc20ca5bd7cef3e1ab3f4/NG5WGL0ljzLsNhSBRVqnD.png)
|
33 |
|
@@ -35,8 +33,6 @@ Here are a few visualizations of the finetune run:
|
|
35 |
|
36 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62afc20ca5bd7cef3e1ab3f4/WgnKQnYIFWkCRSW3JPVAb.png)
|
37 |
|
38 |
-
You can find the experiment on W&B at [this address](https://wandb.ai/dryanfurman/huggingface/runs/1w50nu70?nw=nwuserdryanfurman).
|
39 |
-
|
40 |
|
41 |
## 💻 Usage
|
42 |
|
|
|
21 |
|
22 |
# dfurman/CalmeRys-78B-Orpo-v0.1
|
23 |
|
24 |
+
This model is a finetune of `MaziyarPanahi/calme-2.4-rys-78b` on 1.5k rows of the `mlabonne/orpo-dpo-mix-40k` dataset. It was trained as a generalist language model for a variety of text generation use cases, including support of agentic capabilities, roleplaying, reasoning, multi-turn conversations, long context coherence, and more.
|
|
|
|
|
25 |
|
26 |
## 🦾 Training
|
27 |
|
28 |
+
You can find the experiment on W&B at this [link](https://wandb.ai/dryanfurman/huggingface/runs/1w50nu70?nw=nwuserdryanfurman). Here are a few visualizations:
|
29 |
|
30 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62afc20ca5bd7cef3e1ab3f4/NG5WGL0ljzLsNhSBRVqnD.png)
|
31 |
|
|
|
33 |
|
34 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62afc20ca5bd7cef3e1ab3f4/WgnKQnYIFWkCRSW3JPVAb.png)
|
35 |
|
|
|
|
|
36 |
|
37 |
## 💻 Usage
|
38 |
|