DeepDream2045 commited on
Commit
b892400
1 Parent(s): aba83b9

End of training

Browse files
README.md CHANGED
@@ -103,7 +103,7 @@ xformers_attention: true
103
 
104
  This model is a fine-tuned version of [unsloth/Qwen2-1.5B](https://huggingface.co/unsloth/Qwen2-1.5B) on the None dataset.
105
  It achieves the following results on the evaluation set:
106
- - Loss: 0.4024
107
 
108
  ## Model description
109
 
@@ -141,8 +141,8 @@ The following hyperparameters were used during training:
141
  | Training Loss | Epoch | Step | Validation Loss |
142
  |:-------------:|:------:|:----:|:---------------:|
143
  | 0.551 | 0.0478 | 1 | 0.5565 |
144
- | 0.4206 | 1.2179 | 25 | 0.4251 |
145
- | 0.3508 | 2.4358 | 50 | 0.4024 |
146
 
147
 
148
  ### Framework versions
 
103
 
104
  This model is a fine-tuned version of [unsloth/Qwen2-1.5B](https://huggingface.co/unsloth/Qwen2-1.5B) on the None dataset.
105
  It achieves the following results on the evaluation set:
106
+ - Loss: 0.4025
107
 
108
  ## Model description
109
 
 
141
  | Training Loss | Epoch | Step | Validation Loss |
142
  |:-------------:|:------:|:----:|:---------------:|
143
  | 0.551 | 0.0478 | 1 | 0.5565 |
144
+ | 0.4206 | 1.2179 | 25 | 0.4254 |
145
+ | 0.3513 | 2.4358 | 50 | 0.4025 |
146
 
147
 
148
  ### Framework versions
adapter_config.json CHANGED
@@ -21,12 +21,12 @@
21
  "revision": null,
22
  "target_modules": [
23
  "o_proj",
24
- "v_proj",
25
  "down_proj",
26
- "k_proj",
27
- "up_proj",
28
  "gate_proj",
29
- "q_proj"
 
 
 
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
 
21
  "revision": null,
22
  "target_modules": [
23
  "o_proj",
 
24
  "down_proj",
 
 
25
  "gate_proj",
26
+ "k_proj",
27
+ "v_proj",
28
+ "q_proj",
29
+ "up_proj"
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff189ca5b402715ad1e81120d54b44603fc4a447f97bdea7e05456097d9164c3
3
  size 147859242
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29104c3cc64f1f42fa03e677e6bce2083f5ba4b0461b658db58bba0dd6d874bc
3
  size 147859242
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a22f9375dd7f4f0ada7b41a4e0c78592fc31ad9f3bacce41636af8643d7395a5
3
  size 147770496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a704533d698c7ba0a63169225e51fe598844be04e0004f38d5f187079038e55d
3
  size 147770496
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3dea4593a7a820a778fc84ba6e04d4471ebc30e6df1994d208d89710cfaf65d
3
  size 6776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e94c1e826225abe88b190761b2645c6636cea2d7bee422d5c89d0033daed0be6
3
  size 6776