| 2024-06-25 13:45:10,065 | INFO: Adding LoRA adapters... | |
| 2024-06-25 13:45:11,927 | INFO: Total Parameters: 258306048, Total Trainable Parameters: 258306048 | |
| 2024-06-25 13:45:11,928 | INFO: Trainable Parameters: | |
| 2024-06-25 13:45:12,099 | INFO: Added key: store_based_barrier_key:2 to store for rank: 0 | |
| 2024-06-25 13:45:12,099 | INFO: Rank 0: Completed store-based barrier for key:store_based_barrier_key:2 with 1 nodes. | |