othmanfa commited on
Commit
54cdf88
1 Parent(s): d91e5a4

Training in progress, epoch 20

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f2d88d4cbda5e7158b0e1d5b4028bee4eb1ce2fb849a09c4bfb356fcd1f4589b
3
  size 18883912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dc0f0712e9d807c38797e6d44a58c640c6a28d345958220d09c039dcfc1ef85
3
  size 18883912
runs/Jun03_20-50-07_f28ebe0d2526/events.out.tfevents.1717447816.f28ebe0d2526.34.3 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2716249f06689cce62dc57583c7c3b15ce5ca52fe88491c807c89866a869979a
3
- size 15846
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e934082d0b0e38a2b00b5cfda001a5e668aa686aa9f7a74105300a77ed9ff8d0
3
+ size 16622
wandb/debug-internal.log CHANGED
@@ -7135,3 +7135,119 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
7135
  2024-06-03 21:56:47,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7136
  2024-06-03 21:56:51,673 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7137
  2024-06-03 21:56:52,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7135
  2024-06-03 21:56:47,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7136
  2024-06-03 21:56:51,673 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7137
  2024-06-03 21:56:52,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7138
+ 2024-06-03 21:56:56,674 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7139
+ 2024-06-03 21:56:57,340 INFO Thread-12 :322 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240603_175449-d191dh7n/files/output.log
7140
+ 2024-06-03 21:56:58,120 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7141
+ 2024-06-03 21:57:01,936 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7142
+ 2024-06-03 21:57:03,121 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7143
+ 2024-06-03 21:57:06,937 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7144
+ 2024-06-03 21:57:08,122 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7145
+ 2024-06-03 21:57:11,938 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7146
+ 2024-06-03 21:57:13,122 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7147
+ 2024-06-03 21:57:15,116 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: partial_history
7148
+ 2024-06-03 21:57:15,117 DEBUG SenderThread:322 [sender.py:send():378] send: history
7149
+ 2024-06-03 21:57:15,117 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7150
+ 2024-06-03 21:57:15,118 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7151
+ 2024-06-03 21:57:15,348 INFO Thread-12 :322 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240603_175449-d191dh7n/files/wandb-summary.json
7152
+ 2024-06-03 21:57:15,537 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7153
+ 2024-06-03 21:57:16,939 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7154
+ 2024-06-03 21:57:18,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7155
+ 2024-06-03 21:57:21,948 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7156
+ 2024-06-03 21:57:23,539 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7157
+ 2024-06-03 21:57:26,950 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7158
+ 2024-06-03 21:57:28,540 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7159
+ 2024-06-03 21:57:31,951 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7160
+ 2024-06-03 21:57:33,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7161
+ 2024-06-03 21:57:36,952 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7162
+ 2024-06-03 21:57:38,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7163
+ 2024-06-03 21:57:42,384 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7164
+ 2024-06-03 21:57:43,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7165
+ 2024-06-03 21:57:45,538 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7166
+ 2024-06-03 21:57:47,385 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7167
+ 2024-06-03 21:57:49,540 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7168
+ 2024-06-03 21:57:52,386 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7169
+ 2024-06-03 21:57:54,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7170
+ 2024-06-03 21:57:57,387 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7171
+ 2024-06-03 21:57:59,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7172
+ 2024-06-03 21:58:02,388 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7173
+ 2024-06-03 21:58:04,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7174
+ 2024-06-03 21:58:07,388 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7175
+ 2024-06-03 21:58:09,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7176
+ 2024-06-03 21:58:12,390 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7177
+ 2024-06-03 21:58:14,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7178
+ 2024-06-03 21:58:15,540 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7179
+ 2024-06-03 21:58:17,391 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7180
+ 2024-06-03 21:58:20,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7181
+ 2024-06-03 21:58:22,392 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7182
+ 2024-06-03 21:58:25,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7183
+ 2024-06-03 21:58:27,569 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7184
+ 2024-06-03 21:58:30,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7185
+ 2024-06-03 21:58:32,570 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7186
+ 2024-06-03 21:58:35,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7187
+ 2024-06-03 21:58:37,571 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7188
+ 2024-06-03 21:58:40,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7189
+ 2024-06-03 21:58:42,571 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7190
+ 2024-06-03 21:58:45,540 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7191
+ 2024-06-03 21:58:46,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7192
+ 2024-06-03 21:58:47,649 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7193
+ 2024-06-03 21:58:51,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7194
+ 2024-06-03 21:58:52,650 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7195
+ 2024-06-03 21:58:56,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7196
+ 2024-06-03 21:58:57,651 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7197
+ 2024-06-03 21:59:01,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7198
+ 2024-06-03 21:59:02,652 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7199
+ 2024-06-03 21:59:06,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7200
+ 2024-06-03 21:59:08,095 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7201
+ 2024-06-03 21:59:11,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7202
+ 2024-06-03 21:59:13,096 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7203
+ 2024-06-03 21:59:15,541 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7204
+ 2024-06-03 21:59:17,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7205
+ 2024-06-03 21:59:18,097 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7206
+ 2024-06-03 21:59:22,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7207
+ 2024-06-03 21:59:23,098 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7208
+ 2024-06-03 21:59:27,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7209
+ 2024-06-03 21:59:28,195 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7210
+ 2024-06-03 21:59:28,195 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7211
+ 2024-06-03 21:59:32,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7212
+ 2024-06-03 21:59:33,196 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7213
+ 2024-06-03 21:59:37,546 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7214
+ 2024-06-03 21:59:38,197 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7215
+ 2024-06-03 21:59:42,547 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7216
+ 2024-06-03 21:59:43,198 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7217
+ 2024-06-03 21:59:45,542 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7218
+ 2024-06-03 21:59:48,199 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7219
+ 2024-06-03 21:59:48,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7220
+ 2024-06-03 21:59:53,200 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7221
+ 2024-06-03 21:59:53,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7222
+ 2024-06-03 21:59:58,204 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7223
+ 2024-06-03 21:59:58,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7224
+ 2024-06-03 22:00:03,206 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7225
+ 2024-06-03 22:00:03,546 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7226
+ 2024-06-03 22:00:08,207 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7227
+ 2024-06-03 22:00:08,547 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7228
+ 2024-06-03 22:00:13,208 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7229
+ 2024-06-03 22:00:13,547 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7230
+ 2024-06-03 22:00:15,543 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7231
+ 2024-06-03 22:00:18,209 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7232
+ 2024-06-03 22:00:19,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7233
+ 2024-06-03 22:00:23,210 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7234
+ 2024-06-03 22:00:24,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7235
+ 2024-06-03 22:00:24,561 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: partial_history
7236
+ 2024-06-03 22:00:24,563 DEBUG SenderThread:322 [sender.py:send():378] send: history
7237
+ 2024-06-03 22:00:24,563 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7238
+ 2024-06-03 22:00:24,563 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7239
+ 2024-06-03 22:00:24,922 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7240
+ 2024-06-03 22:00:24,924 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: partial_history
7241
+ 2024-06-03 22:00:24,925 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7242
+ 2024-06-03 22:00:24,925 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7243
+ 2024-06-03 22:00:24,934 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7244
+ 2024-06-03 22:00:24,935 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7245
+ 2024-06-03 22:00:24,935 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7246
+ 2024-06-03 22:00:24,935 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7247
+ 2024-06-03 22:00:24,936 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7248
+ 2024-06-03 22:00:24,936 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7249
+ 2024-06-03 22:00:24,937 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7250
+ 2024-06-03 22:00:24,937 DEBUG SenderThread:322 [sender.py:send():378] send: history
7251
+ 2024-06-03 22:00:24,937 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7252
+ 2024-06-03 22:00:24,937 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7253
+ 2024-06-03 22:00:25,443 INFO Thread-12 :322 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240603_175449-d191dh7n/files/wandb-summary.json
wandb/run-20240603_175449-d191dh7n/files/output.log CHANGED
@@ -322,4 +322,10 @@ Time to retrieve answer: 211.99833258299986
322
  warnings.warn(
323
  /tmp/ipykernel_34/3516238434.py:9: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
324
  return {key: torch.tensor(val[idx]) for key, val in self.examples.items()}
 
 
 
 
 
 
325
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
322
  warnings.warn(
323
  /tmp/ipykernel_34/3516238434.py:9: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
324
  return {key: torch.tensor(val[idx]) for key, val in self.examples.items()}
325
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
326
+ warnings.warn(
327
+ /opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
328
+ warnings.warn(
329
+ /tmp/ipykernel_34/3516238434.py:9: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).
330
+ return {key: torch.tensor(val[idx]) for key, val in self.examples.items()}
331
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240603_175449-d191dh7n/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.0671, "train/grad_norm": 0.9716386198997498, "train/learning_rate": 1.8181818181818182e-05, "train/epoch": 18.181818181818183, "train/global_step": 200, "_timestamp": 1717451645.9421813, "_runtime": 14356.903111457825, "_step": 47, "train_runtime": 4190.3533, "train_samples_per_second": 0.196, "train_steps_per_second": 0.053, "total_flos": 4.4695391805696e+16, "train_loss": 0.8953418861735951}
 
1
+ {"train/loss": 0.0645, "train/grad_norm": 2.141892433166504, "train/learning_rate": 0.0, "train/epoch": 20.0, "train/global_step": 220, "_timestamp": 1717452024.9213681, "_runtime": 14735.882298231125, "_step": 50, "train_runtime": 4192.5433, "train_samples_per_second": 0.196, "train_steps_per_second": 0.052, "total_flos": 4.4695391805696e+16, "train_loss": 0.23985157879916105}
wandb/run-20240603_175449-d191dh7n/logs/debug-internal.log CHANGED
@@ -7135,3 +7135,119 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
7135
  2024-06-03 21:56:47,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7136
  2024-06-03 21:56:51,673 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7137
  2024-06-03 21:56:52,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7135
  2024-06-03 21:56:47,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7136
  2024-06-03 21:56:51,673 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7137
  2024-06-03 21:56:52,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7138
+ 2024-06-03 21:56:56,674 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7139
+ 2024-06-03 21:56:57,340 INFO Thread-12 :322 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240603_175449-d191dh7n/files/output.log
7140
+ 2024-06-03 21:56:58,120 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7141
+ 2024-06-03 21:57:01,936 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7142
+ 2024-06-03 21:57:03,121 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7143
+ 2024-06-03 21:57:06,937 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7144
+ 2024-06-03 21:57:08,122 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7145
+ 2024-06-03 21:57:11,938 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7146
+ 2024-06-03 21:57:13,122 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7147
+ 2024-06-03 21:57:15,116 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: partial_history
7148
+ 2024-06-03 21:57:15,117 DEBUG SenderThread:322 [sender.py:send():378] send: history
7149
+ 2024-06-03 21:57:15,117 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7150
+ 2024-06-03 21:57:15,118 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7151
+ 2024-06-03 21:57:15,348 INFO Thread-12 :322 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240603_175449-d191dh7n/files/wandb-summary.json
7152
+ 2024-06-03 21:57:15,537 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7153
+ 2024-06-03 21:57:16,939 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7154
+ 2024-06-03 21:57:18,538 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7155
+ 2024-06-03 21:57:21,948 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7156
+ 2024-06-03 21:57:23,539 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7157
+ 2024-06-03 21:57:26,950 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7158
+ 2024-06-03 21:57:28,540 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7159
+ 2024-06-03 21:57:31,951 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7160
+ 2024-06-03 21:57:33,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7161
+ 2024-06-03 21:57:36,952 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7162
+ 2024-06-03 21:57:38,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7163
+ 2024-06-03 21:57:42,384 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7164
+ 2024-06-03 21:57:43,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7165
+ 2024-06-03 21:57:45,538 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7166
+ 2024-06-03 21:57:47,385 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7167
+ 2024-06-03 21:57:49,540 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7168
+ 2024-06-03 21:57:52,386 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7169
+ 2024-06-03 21:57:54,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7170
+ 2024-06-03 21:57:57,387 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7171
+ 2024-06-03 21:57:59,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7172
+ 2024-06-03 21:58:02,388 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7173
+ 2024-06-03 21:58:04,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7174
+ 2024-06-03 21:58:07,388 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7175
+ 2024-06-03 21:58:09,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7176
+ 2024-06-03 21:58:12,390 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7177
+ 2024-06-03 21:58:14,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7178
+ 2024-06-03 21:58:15,540 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7179
+ 2024-06-03 21:58:17,391 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7180
+ 2024-06-03 21:58:20,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7181
+ 2024-06-03 21:58:22,392 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7182
+ 2024-06-03 21:58:25,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7183
+ 2024-06-03 21:58:27,569 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7184
+ 2024-06-03 21:58:30,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7185
+ 2024-06-03 21:58:32,570 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7186
+ 2024-06-03 21:58:35,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7187
+ 2024-06-03 21:58:37,571 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7188
+ 2024-06-03 21:58:40,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7189
+ 2024-06-03 21:58:42,571 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7190
+ 2024-06-03 21:58:45,540 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7191
+ 2024-06-03 21:58:46,541 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7192
+ 2024-06-03 21:58:47,649 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7193
+ 2024-06-03 21:58:51,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7194
+ 2024-06-03 21:58:52,650 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7195
+ 2024-06-03 21:58:56,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7196
+ 2024-06-03 21:58:57,651 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7197
+ 2024-06-03 21:59:01,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7198
+ 2024-06-03 21:59:02,652 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7199
+ 2024-06-03 21:59:06,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7200
+ 2024-06-03 21:59:08,095 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7201
+ 2024-06-03 21:59:11,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7202
+ 2024-06-03 21:59:13,096 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7203
+ 2024-06-03 21:59:15,541 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7204
+ 2024-06-03 21:59:17,542 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7205
+ 2024-06-03 21:59:18,097 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7206
+ 2024-06-03 21:59:22,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7207
+ 2024-06-03 21:59:23,098 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7208
+ 2024-06-03 21:59:27,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7209
+ 2024-06-03 21:59:28,195 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7210
+ 2024-06-03 21:59:28,195 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7211
+ 2024-06-03 21:59:32,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7212
+ 2024-06-03 21:59:33,196 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7213
+ 2024-06-03 21:59:37,546 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7214
+ 2024-06-03 21:59:38,197 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7215
+ 2024-06-03 21:59:42,547 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7216
+ 2024-06-03 21:59:43,198 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7217
+ 2024-06-03 21:59:45,542 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7218
+ 2024-06-03 21:59:48,199 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7219
+ 2024-06-03 21:59:48,543 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7220
+ 2024-06-03 21:59:53,200 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7221
+ 2024-06-03 21:59:53,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7222
+ 2024-06-03 21:59:58,204 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7223
+ 2024-06-03 21:59:58,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7224
+ 2024-06-03 22:00:03,206 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7225
+ 2024-06-03 22:00:03,546 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7226
+ 2024-06-03 22:00:08,207 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7227
+ 2024-06-03 22:00:08,547 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7228
+ 2024-06-03 22:00:13,208 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7229
+ 2024-06-03 22:00:13,547 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7230
+ 2024-06-03 22:00:15,543 DEBUG SenderThread:322 [sender.py:send():378] send: stats
7231
+ 2024-06-03 22:00:18,209 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7232
+ 2024-06-03 22:00:19,544 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7233
+ 2024-06-03 22:00:23,210 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: keepalive
7234
+ 2024-06-03 22:00:24,545 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: status_report
7235
+ 2024-06-03 22:00:24,561 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: partial_history
7236
+ 2024-06-03 22:00:24,563 DEBUG SenderThread:322 [sender.py:send():378] send: history
7237
+ 2024-06-03 22:00:24,563 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7238
+ 2024-06-03 22:00:24,563 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7239
+ 2024-06-03 22:00:24,922 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7240
+ 2024-06-03 22:00:24,924 DEBUG HandlerThread:322 [handler.py:handle_request():158] handle_request: partial_history
7241
+ 2024-06-03 22:00:24,925 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7242
+ 2024-06-03 22:00:24,925 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7243
+ 2024-06-03 22:00:24,934 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7244
+ 2024-06-03 22:00:24,935 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7245
+ 2024-06-03 22:00:24,935 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7246
+ 2024-06-03 22:00:24,935 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7247
+ 2024-06-03 22:00:24,936 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7248
+ 2024-06-03 22:00:24,936 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7249
+ 2024-06-03 22:00:24,937 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7250
+ 2024-06-03 22:00:24,937 DEBUG SenderThread:322 [sender.py:send():378] send: history
7251
+ 2024-06-03 22:00:24,937 DEBUG SenderThread:322 [sender.py:send_request():405] send_request: summary_record
7252
+ 2024-06-03 22:00:24,937 INFO SenderThread:322 [sender.py:_save_file():1389] saving file wandb-summary.json with policy end
7253
+ 2024-06-03 22:00:25,443 INFO Thread-12 :322 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240603_175449-d191dh7n/files/wandb-summary.json
wandb/run-20240603_175449-d191dh7n/run-d191dh7n.wandb CHANGED
Binary files a/wandb/run-20240603_175449-d191dh7n/run-d191dh7n.wandb and b/wandb/run-20240603_175449-d191dh7n/run-d191dh7n.wandb differ