Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,21 @@ datasets:
|
|
16 |
|
17 |
# Uploaded model
|
18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
- **Developed by:** Kaan35
|
20 |
- **License:** apache-2.0
|
21 |
- **Finetuned from model :** QWEN-2
|
|
|
16 |
|
17 |
# Uploaded model
|
18 |
|
19 |
+
This Model is trained with alpaca dataset
|
20 |
+
|
21 |
+
warmup_steps = 10,
|
22 |
+
max_steps = 70,
|
23 |
+
|
24 |
+
learning_rate = 2e-5,
|
25 |
+
fp16 = not is_bfloat16_supported(),
|
26 |
+
bf16 = is_bfloat16_supported(),
|
27 |
+
logging_steps = 1,
|
28 |
+
optim = "adamw_8bit",
|
29 |
+
weight_decay = 0.01,
|
30 |
+
lr_scheduler_type = "linear",
|
31 |
+
seed = 3407,
|
32 |
+
output_dir = "outputs",
|
33 |
+
|
34 |
- **Developed by:** Kaan35
|
35 |
- **License:** apache-2.0
|
36 |
- **Finetuned from model :** QWEN-2
|