End of training

README.md

@@ -99,7 +99,7 @@ xformers_attention: null
 
 This model is a fine-tuned version of [peft-internal-testing/tiny-dummy-qwen2](https://huggingface.co/peft-internal-testing/tiny-dummy-qwen2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 11.9312
+- Loss: 11.9313
 
 ## Model description
 
@@ -122,11 +122,8 @@ The following hyperparameters were used during training:
 - train_batch_size: 2
 - eval_batch_size: 2
 - seed: 42
-- distributed_type: multi-GPU
-- num_devices: 2
 - gradient_accumulation_steps: 4
-- total_train_batch_size: 16
-- total_eval_batch_size: 4
+- total_train_batch_size: 8
 - optimizer: Use OptimizerNames.ADAMW_BNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 10
@@ -136,10 +133,10 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 11.9305       | 0.0011 | 1    | 11.9313         |
-| 11.9253       | 0.0034 | 3    | 11.9313         |
-| 11.9317       | 0.0067 | 6    | 11.9313         |
-| 11.9306       | 0.0101 | 9    | 11.9312         |
+| 11.9315       | 0.0006 | 1    | 11.9313         |
+| 11.9319       | 0.0017 | 3    | 11.9313         |
+| 11.926        | 0.0034 | 6    | 11.9313         |
+| 11.9287       | 0.0050 | 9    | 11.9313         |
 
 
 ### Framework versions

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:02e508a82b48161bd5428b10fe747071ffa764826590d87a2c4eee2cc42f49d7
+oid sha256:dc473f88f862e4189f089a6808881b152bf109f340ee467732bb6526c1e2c1e2
 size 21378