Update README.md
Browse files
README.md
CHANGED
@@ -20,22 +20,23 @@ datasets:
|
|
20 |
|
21 |
# saqr-7b-instruct
|
22 |
|
23 |
-
This model is a fine-tuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on
|
24 |
|
25 |
## Model description
|
26 |
|
27 |
-
|
28 |
|
29 |
-
##
|
30 |
|
31 |
-
|
32 |
|
33 |
-
|
34 |
|
35 |
-
More information needed
|
36 |
|
37 |
## Training procedure
|
38 |
|
|
|
|
|
39 |
### Training hyperparameters
|
40 |
|
41 |
The following hyperparameters were used during training:
|
|
|
20 |
|
21 |
# saqr-7b-instruct
|
22 |
|
23 |
+
This model is a fine-tuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on [ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k), [UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback), and [gsm8k](https://huggingface.co/datasets/gsm8k) datasets.
|
24 |
|
25 |
## Model description
|
26 |
|
27 |
+
This model is a finetuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) using supervised finetuning on nearly the same datasets as Zephyr-7B-beta.
|
28 |
|
29 |
+
## Training and evaluation data
|
30 |
|
31 |
+
For training evaluation can be found [here](https://huggingface.co/Menouar/saqr-7b-instruct/tensorboard).
|
32 |
|
33 |
+
For evaluation can be found at Hugging face LeaderBoard [here](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Menouar/saqr-7b-instruct/).
|
34 |
|
|
|
35 |
|
36 |
## Training procedure
|
37 |
|
38 |
+
Can be found [here](https://colab.research.google.com/github/menouarazib/llm/blob/main/Saqr_7B.ipynb).
|
39 |
+
|
40 |
### Training hyperparameters
|
41 |
|
42 |
The following hyperparameters were used during training:
|