willtensora commited on
Commit
d50fe37
·
verified ·
1 Parent(s): 10d52a3

End of training

Browse files
Files changed (2) hide show
  1. README.md +5 -6
  2. adapter_model.bin +2 -2
README.md CHANGED
@@ -1,7 +1,6 @@
1
  ---
2
  library_name: peft
3
- license: apache-2.0
4
- base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
5
  tags:
6
  - axolotl
7
  - generated_from_trainer
@@ -19,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
19
  axolotl version: `0.4.1`
20
  ```yaml
21
  adapter: lora
22
- base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
23
  bf16: auto
24
  chat_template: llama3
25
  dataset_prepared_path: null
@@ -98,9 +97,9 @@ xformers_attention: null
98
 
99
  # 123e4567-e89b-12d3-a456-426614174000
100
 
101
- This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on the None dataset.
102
  It achieves the following results on the evaluation set:
103
- - Loss: 2.1215
104
 
105
  ## Model description
106
 
@@ -132,7 +131,7 @@ The following hyperparameters were used during training:
132
 
133
  | Training Loss | Epoch | Step | Validation Loss |
134
  |:-------------:|:------:|:----:|:---------------:|
135
- | 2.0306 | 0.0001 | 2 | 2.1215 |
136
 
137
 
138
  ### Framework versions
 
1
  ---
2
  library_name: peft
3
+ base_model: peft-internal-testing/tiny-dummy-qwen2
 
4
  tags:
5
  - axolotl
6
  - generated_from_trainer
 
18
  axolotl version: `0.4.1`
19
  ```yaml
20
  adapter: lora
21
+ base_model: peft-internal-testing/tiny-dummy-qwen2
22
  bf16: auto
23
  chat_template: llama3
24
  dataset_prepared_path: null
 
97
 
98
  # 123e4567-e89b-12d3-a456-426614174000
99
 
100
+ This model is a fine-tuned version of [peft-internal-testing/tiny-dummy-qwen2](https://huggingface.co/peft-internal-testing/tiny-dummy-qwen2) on the None dataset.
101
  It achieves the following results on the evaluation set:
102
+ - Loss: 11.9321
103
 
104
  ## Model description
105
 
 
131
 
132
  | Training Loss | Epoch | Step | Validation Loss |
133
  |:-------------:|:------:|:----:|:---------------:|
134
+ | 11.931 | 0.0001 | 2 | 11.9321 |
135
 
136
 
137
  ### Framework versions
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f287570e896bbf607fa496b044c5b389816dd88d71117a754cdb4050af313a40
3
- size 25342042
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ce3b94a56d10480bcdec8ec8369aeccd0d5b0673f1732cfdde3d83d8d2c7953
3
+ size 21378