willtensora
commited on
End of training
Browse files- README.md +5 -6
- adapter_model.bin +2 -2
README.md
CHANGED
@@ -1,7 +1,6 @@
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
-
|
4 |
-
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
|
5 |
tags:
|
6 |
- axolotl
|
7 |
- generated_from_trainer
|
@@ -19,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
19 |
axolotl version: `0.4.1`
|
20 |
```yaml
|
21 |
adapter: lora
|
22 |
-
base_model:
|
23 |
bf16: auto
|
24 |
chat_template: llama3
|
25 |
dataset_prepared_path: null
|
@@ -98,9 +97,9 @@ xformers_attention: null
|
|
98 |
|
99 |
# 123e4567-e89b-12d3-a456-426614174000
|
100 |
|
101 |
-
This model is a fine-tuned version of [
|
102 |
It achieves the following results on the evaluation set:
|
103 |
-
- Loss:
|
104 |
|
105 |
## Model description
|
106 |
|
@@ -132,7 +131,7 @@ The following hyperparameters were used during training:
|
|
132 |
|
133 |
| Training Loss | Epoch | Step | Validation Loss |
|
134 |
|:-------------:|:------:|:----:|:---------------:|
|
135 |
-
|
|
136 |
|
137 |
|
138 |
### Framework versions
|
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
+
base_model: peft-internal-testing/tiny-dummy-qwen2
|
|
|
4 |
tags:
|
5 |
- axolotl
|
6 |
- generated_from_trainer
|
|
|
18 |
axolotl version: `0.4.1`
|
19 |
```yaml
|
20 |
adapter: lora
|
21 |
+
base_model: peft-internal-testing/tiny-dummy-qwen2
|
22 |
bf16: auto
|
23 |
chat_template: llama3
|
24 |
dataset_prepared_path: null
|
|
|
97 |
|
98 |
# 123e4567-e89b-12d3-a456-426614174000
|
99 |
|
100 |
+
This model is a fine-tuned version of [peft-internal-testing/tiny-dummy-qwen2](https://huggingface.co/peft-internal-testing/tiny-dummy-qwen2) on the None dataset.
|
101 |
It achieves the following results on the evaluation set:
|
102 |
+
- Loss: 11.9321
|
103 |
|
104 |
## Model description
|
105 |
|
|
|
131 |
|
132 |
| Training Loss | Epoch | Step | Validation Loss |
|
133 |
|:-------------:|:------:|:----:|:---------------:|
|
134 |
+
| 11.931 | 0.0001 | 2 | 11.9321 |
|
135 |
|
136 |
|
137 |
### Framework versions
|
adapter_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3ce3b94a56d10480bcdec8ec8369aeccd0d5b0673f1732cfdde3d83d8d2c7953
|
3 |
+
size 21378
|