End of training

README.md

@@ -99,7 +99,7 @@ xformers_attention: null
 
 This model is a fine-tuned version of [peft-internal-testing/tiny-dummy-qwen2](https://huggingface.co/peft-internal-testing/tiny-dummy-qwen2) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 11.9313
+- Loss: 11.9312
 
 ## Model description
 
@@ -122,8 +122,11 @@ The following hyperparameters were used during training:
 - train_batch_size: 2
 - eval_batch_size: 2
 - seed: 42
+- distributed_type: multi-GPU
+- num_devices: 8
 - gradient_accumulation_steps: 4
-- total_train_batch_size: 8
+- total_train_batch_size: 64
+- total_eval_batch_size: 16
 - optimizer: Use OptimizerNames.ADAMW_BNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 10
@@ -133,10 +136,10 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 11.9315       | 0.0006 | 1    | 11.9313         |
-| 11.9319       | 0.0017 | 3    | 11.9313         |
-| 11.926        | 0.0034 | 6    | 11.9313         |
-| 11.9287       | 0.0050 | 9    | 11.9313         |
+| 11.9309       | 0.0045 | 1    | 11.9313         |
+| 11.9313       | 0.0135 | 3    | 11.9313         |
+| 11.9318       | 0.0269 | 6    | 11.9313         |
+| 11.9313       | 0.0404 | 9    | 11.9312         |
 
 
 ### Framework versions

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5d0292bd53fc5ea1a676dd15b66b63c7950c6f08104923e1fe043cba383b7ea9
+oid sha256:16ff41a2be4704585ad2a5d2d9b3e7ff90a390f28dd3d4fca4bff18af96b0b3c
 size 21378