Kaan35 commited on
Commit
b9b7d2a
1 Parent(s): b8fe3b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -16,6 +16,21 @@ datasets:
16
 
17
  # Uploaded model
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  - **Developed by:** Kaan35
20
  - **License:** apache-2.0
21
  - **Finetuned from model :** QWEN-2
 
16
 
17
  # Uploaded model
18
 
19
+ This Model is trained with alpaca dataset
20
+
21
+ warmup_steps = 10,
22
+ max_steps = 70,
23
+
24
+ learning_rate = 2e-5,
25
+ fp16 = not is_bfloat16_supported(),
26
+ bf16 = is_bfloat16_supported(),
27
+ logging_steps = 1,
28
+ optim = "adamw_8bit",
29
+ weight_decay = 0.01,
30
+ lr_scheduler_type = "linear",
31
+ seed = 3407,
32
+ output_dir = "outputs",
33
+
34
  - **Developed by:** Kaan35
35
  - **License:** apache-2.0
36
  - **Finetuned from model :** QWEN-2