End of training

README.md

@@ -122,8 +122,11 @@ The following hyperparameters were used during training:
 - train_batch_size: 2
 - eval_batch_size: 2
 - seed: 42
+- distributed_type: multi-GPU
+- num_devices: 2
 - gradient_accumulation_steps: 4
-- total_train_batch_size: 8
+- total_train_batch_size: 16
+- total_eval_batch_size: 4
 - optimizer: Use OptimizerNames.ADAMW_BNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_steps: 10
@@ -133,10 +136,10 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 11.9315       | 0.0006 | 1    | 11.9313         |
-| 11.9319       | 0.0017 | 3    | 11.9313         |
-| 11.926        | 0.0034 | 6    | 11.9313         |
-| 11.9287       | 0.0050 | 9    | 11.9313         |
+| 11.9305       | 0.0011 | 1    | 11.9313         |
+| 11.9253       | 0.0034 | 3    | 11.9313         |
+| 11.9317       | 0.0067 | 6    | 11.9313         |
+| 11.9306       | 0.0101 | 9    | 11.9313         |
 
 
 ### Framework versions

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ad2baf62aac9cf16a2ff4bee7c348002296775c72ff07db09288b398142cba6
+oid sha256:50d840eb0345ce290f72feeb0ff3ce38889437ad042f185ccc81852d76a8bbc6
 size 21378