2022-01-20 13:56:50,313 INFO MainThread:2513451 [internal.py:wandb_internal():87] W&B internal server running at pid: 2513451, started at: 2022-01-20 13:56:50.313559 2022-01-20 13:56:50,316 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: check_version 2022-01-20 13:56:50,316 INFO WriterThread:2513451 [datastore.py:open_for_write():77] open: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/run-r5vgtpr6.wandb 2022-01-20 13:56:50,317 DEBUG SenderThread:2513451 [sender.py:send():234] send: header 2022-01-20 13:56:50,317 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: check_version 2022-01-20 13:56:50,355 DEBUG SenderThread:2513451 [sender.py:send():234] send: run 2022-01-20 13:56:50,529 INFO SenderThread:2513451 [dir_watcher.py:__init__():169] watching files in: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files 2022-01-20 13:56:50,529 INFO SenderThread:2513451 [sender.py:_start_run_threads():804] run started: r5vgtpr6 with start time 1642687009 2022-01-20 13:56:50,529 DEBUG SenderThread:2513451 [sender.py:send():234] send: summary 2022-01-20 13:56:50,529 INFO SenderThread:2513451 [sender.py:_save_file():939] saving file wandb-summary.json with policy end 2022-01-20 13:56:50,530 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: run_start 2022-01-20 13:56:50,531 DEBUG HandlerThread:2513451 [meta.py:__init__():40] meta init 2022-01-20 13:56:50,531 DEBUG HandlerThread:2513451 [meta.py:__init__():54] meta init done 2022-01-20 13:56:50,531 DEBUG HandlerThread:2513451 [meta.py:probe():214] probe 2022-01-20 13:56:50,532 DEBUG HandlerThread:2513451 [meta.py:_setup_git():204] setup git 2022-01-20 13:56:50,581 DEBUG HandlerThread:2513451 [meta.py:_setup_git():211] setup git done 2022-01-20 13:56:50,581 DEBUG HandlerThread:2513451 [meta.py:_save_code():92] save code 2022-01-20 13:56:50,589 DEBUG HandlerThread:2513451 [meta.py:_save_code():113] save code done 2022-01-20 13:56:50,589 DEBUG HandlerThread:2513451 [meta.py:_save_patches():130] save patches 2022-01-20 13:56:50,637 DEBUG HandlerThread:2513451 [meta.py:_save_patches():172] save patches done 2022-01-20 13:56:50,637 DEBUG HandlerThread:2513451 [meta.py:_save_pip():58] save pip 2022-01-20 13:56:50,638 DEBUG HandlerThread:2513451 [meta.py:_save_pip():72] save pip done 2022-01-20 13:56:50,638 DEBUG HandlerThread:2513451 [meta.py:probe():252] probe done 2022-01-20 13:56:50,683 DEBUG SenderThread:2513451 [sender.py:send():234] send: files 2022-01-20 13:56:50,683 INFO SenderThread:2513451 [sender.py:_save_file():939] saving file wandb-metadata.json with policy now 2022-01-20 13:56:50,683 INFO SenderThread:2513451 [sender.py:_save_file():939] saving file code/run_mlm_flax.py with policy now 2022-01-20 13:56:50,684 INFO SenderThread:2513451 [sender.py:_save_file():939] saving file diff.patch with policy now 2022-01-20 13:56:50,689 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:56:50,689 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:56:50,825 DEBUG SenderThread:2513451 [sender.py:send():234] send: config 2022-01-20 13:56:50,826 DEBUG SenderThread:2513451 [sender.py:send():234] send: config 2022-01-20 13:56:50,826 DEBUG SenderThread:2513451 [sender.py:send():234] send: config 2022-01-20 13:56:51,178 INFO Thread-12 :2513451 [upload_job.py:push():137] Uploaded file /tmp/tmpmj3rw54hwandb/jdk6ushy-code/run_mlm_flax.py 2022-01-20 13:56:51,188 INFO Thread-11 :2513451 [upload_job.py:push():137] Uploaded file /tmp/tmpmj3rw54hwandb/2iv3mbwv-wandb-metadata.json 2022-01-20 13:56:51,193 INFO Thread-13 :2513451 [upload_job.py:push():137] Uploaded file /tmp/tmpmj3rw54hwandb/1e0nwcz6-diff.patch 2022-01-20 13:56:51,530 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/wandb-summary.json 2022-01-20 13:56:51,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/requirements.txt 2022-01-20 13:56:51,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:56:51,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/diff.patch 2022-01-20 13:56:51,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/wandb-metadata.json 2022-01-20 13:56:51,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/code/run_mlm_flax.py 2022-01-20 13:56:51,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_created():217] file/dir created: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/code 2022-01-20 13:56:53,530 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:56:59,533 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:57:05,839 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:57:05,839 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:57:18,638 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 13:57:20,988 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:57:20,989 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:57:21,544 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/config.yaml 2022-01-20 13:57:36,142 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:57:36,142 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:57:48,714 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 13:57:51,281 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:57:51,281 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:57:59,561 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:58:06,492 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:58:06,493 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:58:18,788 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 13:58:21,660 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:58:21,661 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:58:36,818 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:58:36,818 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:58:48,865 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 13:58:51,968 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:58:51,968 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:59:07,108 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:59:07,109 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:59:18,944 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 13:59:22,352 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:59:22,353 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:59:27,605 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:29,606 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:31,607 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:33,608 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:35,609 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:37,487 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:59:37,488 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:59:37,610 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:39,611 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:41,612 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:43,613 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:45,614 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:47,615 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:49,088 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 13:59:49,616 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:51,617 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:52,631 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 13:59:52,631 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 13:59:53,619 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:55,620 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:57,621 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 13:59:59,622 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:01,623 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:03,624 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:05,625 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:07,626 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:07,765 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:00:07,765 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:00:09,627 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:11,628 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:13,629 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:15,630 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:17,632 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:19,162 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:00:19,633 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:21,634 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:22,904 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:00:22,905 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:00:23,635 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:25,636 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:27,637 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:29,638 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:31,640 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:33,641 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:35,642 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:37,643 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:38,048 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:00:38,048 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:00:39,644 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:41,646 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:43,647 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:45,648 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:47,649 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:49,235 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:00:49,650 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:51,651 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:53,239 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:00:53,239 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:00:53,652 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:55,653 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:57,654 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:00:59,655 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:01,656 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:03,657 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:05,658 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:07,659 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:08,380 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:01:08,380 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:01:09,660 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:11,661 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:13,662 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:15,663 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:17,664 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:19,308 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:01:19,665 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:21,666 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:23,534 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:01:23,534 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:01:23,668 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:25,669 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:27,670 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:29,671 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:31,671 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:33,672 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:35,673 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:37,674 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:38,704 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:01:38,705 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:01:39,675 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:41,676 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:43,677 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:45,678 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:47,679 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:49,382 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:01:49,680 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:51,681 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:53,682 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:53,857 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:01:53,857 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:01:55,683 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:57,683 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:01:59,684 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:01,685 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:03,686 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:05,687 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:07,687 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:09,047 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:02:09,048 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:02:09,688 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:11,690 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:13,691 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:15,692 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:17,693 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:19,453 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:02:19,694 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:21,694 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:23,695 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:24,189 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:02:24,189 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:02:25,696 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:27,697 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:29,698 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:31,699 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:33,700 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:35,701 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:37,702 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:39,327 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:02:39,327 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:02:39,703 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:41,704 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:43,705 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:45,706 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:47,707 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:49,524 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:02:49,708 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:51,709 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:53,710 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:54,469 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:02:54,469 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:02:55,711 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:57,712 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:02:59,713 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:01,714 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:03,715 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:05,716 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:07,717 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:09,622 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:03:09,623 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:03:09,718 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:11,719 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:13,720 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:15,721 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:17,722 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:19,598 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:03:19,723 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:21,724 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:23,725 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:24,760 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:03:24,761 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:03:25,725 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:27,726 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:29,727 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:31,728 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:33,729 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:35,730 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:37,731 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:39,732 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:39,903 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:03:39,903 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:03:41,733 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:43,734 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:45,735 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:47,736 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:49,674 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:03:49,737 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:51,738 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:53,739 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:55,039 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:03:55,039 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:03:55,740 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:57,741 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:03:59,742 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:01,743 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:03,744 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:05,745 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:07,746 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:09,746 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:10,177 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:04:10,177 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:04:11,747 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:13,748 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:15,749 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:17,750 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:19,747 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:04:19,751 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:21,752 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:23,753 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:25,339 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:04:25,340 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:04:25,754 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:27,755 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:29,756 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:31,757 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:33,758 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:35,759 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:37,760 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:39,761 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:40,487 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:04:40,487 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:04:41,763 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:43,764 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:45,765 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:47,766 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:49,766 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:49,818 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:04:51,767 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:53,768 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:55,633 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:04:55,633 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:04:55,769 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:57,770 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:04:59,771 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:02,773 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:04,774 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:06,775 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:08,776 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:10,769 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:05:10,770 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:05:10,777 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:12,778 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:14,779 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:16,780 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:18,781 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:19,886 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:05:20,782 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:22,783 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:24,784 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:25,914 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:05:25,914 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:05:26,786 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:28,787 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:30,788 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:32,789 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:34,790 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:36,791 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:38,792 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:40,793 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:41,081 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:05:41,081 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:05:42,794 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:44,795 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:46,797 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:48,798 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:49,955 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:05:50,799 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:52,800 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:54,801 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:56,221 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:05:56,221 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:05:56,802 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:05:58,803 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:00,804 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:02,805 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:04,807 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:06,808 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:08,809 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:10,810 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:11,353 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:06:11,354 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:06:12,811 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:14,812 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:16,813 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:18,814 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:20,025 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:06:20,815 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:22,816 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:24,817 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:26,499 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:06:26,500 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:06:26,818 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:28,819 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:30,820 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:32,821 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:34,822 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:36,822 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:38,824 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:40,825 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:41,639 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:06:41,640 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:06:42,826 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:44,826 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:46,827 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:48,828 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:50,096 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:06:50,829 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:52,830 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:54,831 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:56,780 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:06:56,780 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:06:56,832 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:06:58,833 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:00,834 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:02,835 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:04,836 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:06,838 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:08,839 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:10,840 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:11,920 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:07:11,920 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:07:12,841 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:14,842 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:16,843 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:18,844 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:20,171 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:07:20,845 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:22,846 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:24,846 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:26,847 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:27,065 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:07:27,065 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:07:28,848 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:30,849 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:32,850 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:34,851 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:36,852 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:38,853 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:40,854 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:42,202 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:07:42,203 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:07:42,855 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:44,856 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:46,857 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:48,858 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:50,248 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:07:50,859 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:52,860 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:54,861 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:56,862 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:07:57,341 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:07:57,342 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:07:58,863 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:00,864 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:02,865 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:04,866 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:06,867 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:08,868 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:10,869 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:12,483 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:08:12,483 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:08:12,870 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:14,872 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:16,873 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:18,874 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:20,326 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:08:20,875 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:22,876 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:24,877 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:26,878 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:27,625 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:08:27,625 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:08:28,879 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:30,880 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:32,880 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:34,882 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:36,883 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:38,884 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:40,885 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:42,763 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:08:42,764 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:08:42,886 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:44,887 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:46,888 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:48,889 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:50,401 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:08:50,890 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:52,891 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:54,892 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:56,893 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:08:57,899 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:08:57,900 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:08:58,894 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:00,895 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:02,896 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:04,897 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:06,898 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:08,899 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:10,900 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:12,900 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:13,162 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:09:13,163 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:09:14,901 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:16,902 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:18,903 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:20,476 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:09:20,904 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:22,905 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:24,905 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:26,906 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:28,299 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:09:28,299 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:09:28,907 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:30,908 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:32,909 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:34,910 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:36,911 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:38,912 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:40,913 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:42,913 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:43,439 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:09:43,439 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:09:44,914 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:46,915 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:48,916 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:50,551 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:09:50,917 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:52,918 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:54,919 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:56,919 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:09:58,582 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:09:58,582 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:09:58,920 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:00,921 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:02,922 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:04,923 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:06,924 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:08,925 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:10,926 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:12,926 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:13,825 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:10:13,825 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:10:14,928 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:16,929 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:18,929 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:20,622 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:10:20,930 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:22,931 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:24,932 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:26,933 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:28,934 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:29,415 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:10:29,416 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:10:30,935 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:32,935 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:34,936 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:36,937 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:38,938 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:40,939 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:42,940 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:44,553 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:10:44,553 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:10:44,941 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:46,942 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:48,942 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:50,692 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:10:50,943 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:52,944 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:54,945 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:56,946 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:58,947 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:10:59,686 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:10:59,686 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:11:00,948 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:02,949 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:04,950 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:06,951 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:08,951 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:10,952 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:12,953 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:14,873 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:11:14,873 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:11:14,954 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:16,955 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:18,956 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:20,765 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:11:20,957 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:22,958 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:24,959 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:26,960 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:28,961 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:30,010 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:11:30,010 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:11:30,961 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:32,962 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:34,963 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:36,964 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:38,965 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:40,966 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:42,967 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:44,968 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:45,155 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:11:45,155 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:11:46,969 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:48,969 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:50,837 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:11:50,970 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:52,971 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:54,972 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:56,973 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:11:58,974 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:00,293 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:12:00,294 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:12:00,975 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:02,976 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:04,977 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:06,978 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:08,978 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:10,979 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:12,980 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:14,981 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:15,449 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:12:15,449 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:12:16,982 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:18,983 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:20,909 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:12:20,984 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:22,985 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:24,986 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:26,987 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:28,988 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:30,792 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:12:30,792 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:12:30,989 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:32,990 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:34,990 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:36,991 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:38,992 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:40,993 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:42,994 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:44,995 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:45,927 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:12:45,927 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:12:46,996 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:48,996 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:50,980 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:12:50,997 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:52,998 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:54,999 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:57,000 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:12:59,001 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:01,002 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:01,066 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:13:01,066 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:13:03,003 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:05,004 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:07,005 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:09,006 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:11,007 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:13,007 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:15,008 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:16,215 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:13:16,215 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:13:17,009 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:19,010 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:21,011 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:21,053 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:13:23,012 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:25,013 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:27,014 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:29,015 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:31,016 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:31,367 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:13:31,367 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:13:33,017 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:35,018 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:37,019 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:39,020 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:41,021 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:43,022 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:45,023 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:46,517 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:13:46,517 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:13:47,024 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:49,025 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:51,026 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:51,127 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:13:53,027 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:55,028 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:57,030 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:13:59,030 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:01,031 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:01,656 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:14:01,657 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:14:03,032 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:05,033 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:07,034 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:09,035 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:11,035 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:13,036 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:15,037 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:16,841 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:14:16,842 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:14:17,038 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:19,039 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:21,040 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:21,197 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:14:23,041 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:25,042 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:27,042 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:29,043 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:31,044 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:31,988 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:14:31,988 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:14:33,045 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:35,046 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:37,047 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:39,047 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:41,048 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:43,049 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:45,050 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:47,051 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:47,128 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:14:47,128 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:14:49,052 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:51,052 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:51,265 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:14:53,053 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:55,054 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:57,055 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:14:59,056 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:01,056 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:02,265 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:15:02,266 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:15:03,057 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:05,058 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:07,059 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:09,059 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:12,061 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:14,062 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:16,063 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:17,402 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:15:17,403 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:15:18,064 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:20,065 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:21,331 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:15:22,066 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:24,066 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:26,067 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:28,068 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:30,069 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:32,070 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:32,553 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:15:32,554 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:15:34,071 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:36,072 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:38,073 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:40,074 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:42,075 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:44,076 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:46,077 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:47,711 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:15:47,711 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:15:48,078 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:50,079 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:51,399 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:15:52,080 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:54,081 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:56,082 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:15:58,083 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:00,083 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:02,084 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:02,853 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:16:02,854 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:16:04,085 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:06,086 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:07,086 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:08,087 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:10,088 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:17,992 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:16:17,992 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:16:18,091 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:20,092 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:21,470 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:16:22,093 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:24,094 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:26,095 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:28,096 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:30,097 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:32,098 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:33,141 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:16:33,142 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:16:34,099 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:36,100 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:38,101 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:40,102 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:42,103 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:44,104 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:46,104 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:48,105 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:48,291 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:16:48,292 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:16:50,106 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:51,538 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:16:52,107 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:54,108 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:56,109 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:16:58,110 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:00,111 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:02,112 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:03,428 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:17:03,429 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:17:04,113 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:06,113 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:08,114 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:10,115 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:12,116 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:14,117 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:16,118 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:18,119 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:18,609 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:17:18,609 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:17:20,120 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:21,608 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:17:22,121 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:24,122 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:26,123 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:28,123 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:30,124 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:32,125 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:33,753 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:17:33,753 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:17:34,126 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:36,127 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:38,128 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:40,129 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:42,130 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:44,131 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:46,131 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:48,132 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:48,886 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:17:48,886 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:17:50,133 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:51,677 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:17:52,134 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:54,135 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:56,136 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:17:58,136 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:00,137 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:02,138 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:04,021 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:18:04,021 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:18:04,139 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:06,140 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:08,141 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:10,142 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:12,142 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:14,143 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:16,144 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:18,145 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:19,159 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:18:19,160 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:18:20,146 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:21,748 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:18:22,147 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:24,148 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:26,149 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:28,150 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:30,151 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:32,151 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:34,152 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:34,312 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:18:34,313 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:18:36,154 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:38,154 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:40,155 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:42,156 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:44,157 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:46,158 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:48,159 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:49,447 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:18:49,448 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:18:50,160 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:51,818 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:18:52,161 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:54,162 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:56,163 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:18:58,164 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:00,165 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:02,165 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:04,166 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:04,639 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:19:04,639 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:19:06,167 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:08,168 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:10,168 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:12,169 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:14,170 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:16,171 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:18,172 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:19,803 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:19:19,804 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:19:20,172 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:21,888 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:19:22,173 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:24,174 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:26,175 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:28,176 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:30,177 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:32,178 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:34,179 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:34,944 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:19:34,944 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:19:36,180 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:38,181 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:40,181 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:42,182 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:44,183 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:46,184 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:48,185 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:50,097 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:19:50,097 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:19:50,186 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:51,957 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:19:52,186 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:54,187 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:56,188 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:19:58,189 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:00,190 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:02,191 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:04,192 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:05,236 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:20:05,236 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:20:06,192 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:08,193 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:10,194 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:12,195 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:14,195 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:16,196 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:18,197 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:20,198 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:20,374 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:20:20,374 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:20:22,034 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:20:22,199 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:24,199 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:26,200 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:28,201 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:30,202 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:32,203 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:34,203 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:35,513 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:20:35,513 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:20:36,204 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:38,205 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:40,206 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:42,207 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:44,208 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:46,209 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:48,210 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:50,211 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:50,651 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:20:50,651 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:20:52,104 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:20:52,211 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:54,212 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:56,213 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:20:58,214 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:00,215 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:02,216 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:04,217 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:05,812 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:21:05,812 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:21:06,218 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:08,219 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:10,219 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:12,220 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:14,221 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:16,222 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:18,222 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:20,223 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:20,949 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:21:20,949 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:21:22,174 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:21:22,224 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:24,225 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:26,225 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:28,226 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:30,227 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:32,228 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:34,229 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:36,114 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:21:36,114 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:21:36,230 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:38,231 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:40,231 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:42,232 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:44,233 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:46,234 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:48,235 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:50,236 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:51,259 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:21:51,259 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:21:52,237 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:52,239 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:21:54,237 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:56,238 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:21:58,239 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:00,240 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:02,241 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:04,242 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:06,243 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:06,393 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:22:06,393 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:22:08,244 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:10,244 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:12,245 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:14,246 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:16,247 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:18,248 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:20,249 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:21,544 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:22:21,544 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:22:22,249 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:22,306 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:22:24,250 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:26,251 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:28,252 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:30,253 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:32,254 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:34,254 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:36,255 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:36,683 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:22:36,683 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:22:39,256 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:41,257 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:43,258 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:45,259 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:47,260 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:49,261 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:51,262 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:51,859 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:22:51,859 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:22:52,378 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:22:53,263 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:55,264 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:57,264 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:22:59,265 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:01,266 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:03,267 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:05,268 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:07,031 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:23:07,031 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:23:07,268 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:09,269 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:11,270 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:13,271 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:15,272 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:17,273 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:19,273 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:21,274 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:22,174 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:23:22,174 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:23:22,449 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:23:23,275 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:25,276 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:27,277 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:29,278 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:31,279 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:33,280 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:35,280 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:37,281 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:37,314 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:23:37,314 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:23:39,282 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:41,283 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:43,284 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:45,285 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:47,285 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:49,286 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:51,287 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:52,490 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:23:52,490 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:23:52,643 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:23:53,288 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:55,289 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:57,289 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:23:59,290 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:01,291 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:03,292 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:05,293 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:07,293 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:07,645 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:24:07,645 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:24:09,294 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:11,295 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:13,296 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:15,297 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:17,298 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:19,298 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:21,299 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:22,588 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:24:22,934 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:24:22,934 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:24:23,300 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:25,301 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:27,302 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:29,302 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:31,303 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:33,304 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:35,305 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:37,306 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:38,101 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:24:38,102 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:24:39,306 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:41,307 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:43,308 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:45,309 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:47,310 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:49,310 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:51,311 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:52,657 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:24:53,291 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:24:53,292 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:24:53,312 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:55,313 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:57,313 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:24:59,314 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:01,315 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:03,316 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:05,317 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:07,318 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:08,438 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:25:08,438 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:25:09,319 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:11,320 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:13,321 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:15,321 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:17,322 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:19,323 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:21,324 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:22,729 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:25:23,325 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:23,583 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:25:23,583 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:25:25,326 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:27,327 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:29,328 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:31,328 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:33,329 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:35,330 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:37,331 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:38,722 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:25:38,722 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:25:39,332 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:41,332 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:43,333 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:45,334 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:47,335 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:49,336 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:51,337 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:52,801 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:25:53,337 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:53,871 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:25:53,871 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:25:55,338 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:57,339 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:25:59,340 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:01,341 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:03,342 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:05,343 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:07,343 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:09,008 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:26:09,009 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:26:09,344 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:11,345 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:13,346 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:15,347 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:17,348 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:19,348 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:21,349 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:22,872 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:26:23,350 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:24,147 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:26:24,147 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:26:25,351 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:27,352 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:29,352 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:31,353 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:33,354 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:35,355 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:37,356 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:39,289 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:26:39,290 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:26:39,357 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:41,357 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:43,358 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:45,359 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:47,360 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:49,360 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:51,361 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:52,942 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:26:53,362 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:54,436 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:26:54,437 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:26:55,363 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:57,364 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:26:59,365 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:01,365 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:03,366 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:05,367 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:07,368 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:09,369 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:09,575 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:27:09,575 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:27:11,370 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:13,370 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:15,371 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:17,372 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:19,373 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:21,374 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:23,012 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:27:23,375 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:24,720 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:27:24,721 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:27:25,376 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:27,376 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:29,377 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:31,378 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:33,379 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:35,380 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:37,380 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:39,381 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:39,926 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:27:39,927 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:27:41,382 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:43,382 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:45,383 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:47,384 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:27:53,085 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:27:55,068 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:27:55,069 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:28:07,392 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:09,393 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:10,213 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:28:10,213 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:28:11,394 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:13,395 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:16,396 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:18,397 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:20,398 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:22,399 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:23,164 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:28:24,400 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:25,369 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:28:25,369 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:28:26,401 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:28,401 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:30,402 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:32,403 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:34,404 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:36,405 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:38,406 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:40,407 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:40,510 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:28:40,510 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:28:42,408 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:44,409 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:46,410 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:48,411 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:50,412 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:52,413 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:53,238 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:28:54,413 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:55,648 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:28:55,649 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:28:56,414 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:28:58,415 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:00,416 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:02,417 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:04,418 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:06,419 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:08,420 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:10,421 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:10,800 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:29:10,800 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:29:12,422 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:14,423 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:16,423 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:18,424 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:20,425 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:22,426 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:23,313 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:29:24,427 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:25,944 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:29:25,944 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:29:26,428 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:28,428 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:30,429 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:32,430 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:34,431 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:36,432 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:38,433 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:40,434 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:41,316 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:29:41,316 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:29:42,434 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:44,435 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:46,436 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:48,437 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:50,438 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:52,439 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:53,382 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:29:54,440 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:56,441 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:29:56,455 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:29:56,456 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:29:58,442 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:00,443 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:02,444 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:04,444 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:06,445 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:08,446 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:10,447 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:11,593 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:30:11,593 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:30:12,448 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:14,449 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:16,450 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:18,451 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:20,452 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:22,453 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:23,455 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:30:24,454 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:26,455 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:26,734 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:30:26,734 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:30:28,456 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:30,457 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:32,457 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:34,458 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:36,459 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:38,460 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:40,460 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:41,886 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:30:41,887 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:30:42,461 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:44,462 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:46,463 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:48,464 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:50,465 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:52,466 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:53,527 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:30:54,467 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:56,468 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:30:57,033 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:30:57,033 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:30:58,469 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:00,469 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:02,470 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:04,471 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:06,472 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:08,473 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:10,474 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:12,198 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:31:12,198 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:31:12,475 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:14,476 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:16,477 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:18,478 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:20,479 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:22,480 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:23,602 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:31:24,481 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:26,482 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:27,350 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:31:27,351 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:31:28,483 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:30,483 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:32,484 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:34,485 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:36,486 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:38,487 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:40,488 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:42,489 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:42,570 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:31:42,570 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:31:44,490 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:46,491 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:48,491 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:50,492 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:52,493 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:53,677 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:31:54,494 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:56,495 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:31:57,711 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:31:57,711 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:31:58,496 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:00,497 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:02,497 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:04,498 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:06,499 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:08,500 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:10,501 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:12,502 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:12,851 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:32:12,851 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:32:14,503 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:16,503 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:18,504 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:20,505 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:22,506 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:23,747 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:32:24,507 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:26,508 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:27,993 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:32:27,994 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:32:28,509 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:30,510 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:32,511 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:34,512 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:36,513 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:38,514 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:40,515 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:42,515 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:43,163 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:32:43,163 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:32:44,516 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:46,517 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:48,518 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:50,519 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:52,520 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:53,815 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:32:54,521 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:56,522 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:32:58,303 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:32:58,303 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:32:58,522 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:00,523 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:02,524 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:04,525 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:06,526 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:08,527 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:10,528 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:12,528 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:13,454 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:33:13,455 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:33:14,529 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:16,530 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:18,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:20,532 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:22,533 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:23,886 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:33:24,533 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:26,534 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:28,535 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:28,599 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:33:28,599 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:33:30,536 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:32,537 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:34,538 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:36,539 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:38,539 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:40,540 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:42,541 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:43,859 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:33:43,860 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:33:44,542 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:46,543 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:48,544 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:50,544 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:52,545 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:53,960 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:33:54,546 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:56,546 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:58,547 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:33:58,997 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:33:58,998 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:34:00,548 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:02,549 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:04,549 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:06,550 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:08,551 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:10,552 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:12,553 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:14,139 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:34:14,139 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:34:14,554 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:16,554 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:18,555 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:20,556 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:22,556 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:24,033 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:34:24,557 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:26,558 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:28,559 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:29,294 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:34:29,295 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:34:30,560 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:32,560 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:34,561 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:36,562 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:38,563 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:40,564 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:42,564 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:44,432 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:34:44,433 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:34:44,565 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:46,566 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:48,566 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:50,567 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:52,568 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:54,107 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:34:54,569 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:56,570 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:58,570 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:34:59,901 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:34:59,901 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:35:00,571 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:02,572 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:04,573 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:06,573 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:08,574 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:10,575 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:12,576 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:14,577 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:15,048 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:35:15,049 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:35:16,577 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:18,578 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:20,579 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:22,580 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:24,179 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:35:25,582 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:27,583 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:29,583 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:30,270 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:35:30,271 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:35:31,584 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:33,585 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:35,586 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:37,587 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:39,588 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:41,589 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:43,590 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:45,414 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:35:45,414 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:35:45,591 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:47,592 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:49,592 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:51,593 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:53,594 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:54,252 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:35:55,595 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:57,596 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:35:59,597 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:00,551 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:36:00,551 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:36:01,598 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:03,599 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:05,600 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:07,601 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:09,602 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:11,602 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:13,603 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:15,604 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:15,703 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:36:15,704 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:36:17,605 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:19,606 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:21,607 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:23,608 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:24,323 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:36:25,609 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:27,609 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:29,610 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:30,869 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:36:30,870 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:36:31,611 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:33,612 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:35,613 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:37,614 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:39,614 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:41,615 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:43,616 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:45,617 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:46,005 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:36:46,006 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:36:47,618 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:49,618 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:51,619 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:53,620 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:54,398 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:36:55,621 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:57,622 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:36:59,623 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:01,624 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:02,681 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:37:02,681 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:37:03,625 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:05,625 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:07,626 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:09,627 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:11,628 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:13,629 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:15,630 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:17,630 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:17,847 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:37:17,848 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:37:19,631 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:21,632 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:23,632 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:24,472 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:37:25,633 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:27,634 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:29,635 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:31,635 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:32,987 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:37:32,987 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:37:33,636 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:35,637 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:37,638 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:39,638 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:41,639 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:43,640 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:45,641 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:47,641 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:48,124 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:37:48,124 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:37:49,642 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:51,643 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:53,644 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:54,546 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:37:55,644 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:57,645 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:37:59,646 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:01,647 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:03,292 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:38:03,292 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:38:03,648 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:05,649 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:07,650 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:09,650 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:11,651 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:13,652 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:15,653 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:17,654 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:18,430 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:38:18,431 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:38:19,655 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:21,655 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:23,656 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:24,618 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:38:25,657 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:27,658 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:29,659 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:31,660 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:33,566 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:38:33,566 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:38:33,660 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:35,661 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:37,662 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:39,663 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:41,664 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:43,664 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:45,665 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:47,666 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:48,749 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:38:48,749 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:38:49,667 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:51,668 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:53,669 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:54,693 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:38:55,670 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:57,670 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:38:59,672 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:01,673 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:03,673 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:03,894 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:39:03,894 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:39:05,674 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:07,675 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:09,676 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:11,677 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:13,678 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:15,679 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:17,680 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:19,039 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:39:19,039 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:39:19,681 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:21,682 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:23,683 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:24,764 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:39:25,684 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:27,685 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:29,686 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:31,687 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:33,688 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:34,194 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:39:34,194 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:39:35,689 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:37,690 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:39,691 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:41,692 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:43,693 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:45,694 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:47,695 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:49,440 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:39:49,441 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:39:49,696 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:51,697 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:53,698 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:54,836 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:39:55,699 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:57,700 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:39:59,701 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:01,702 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:03,703 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:04,587 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:40:04,587 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:40:05,704 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:07,705 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:09,706 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:11,707 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:13,708 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:15,709 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:17,710 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:19,711 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:19,753 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:40:19,754 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:40:21,712 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:23,713 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:24,912 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:40:25,714 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:27,715 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:29,716 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:31,717 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:33,718 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:34,895 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:40:34,896 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:40:35,719 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:37,720 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:39,721 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:41,722 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:43,723 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:45,724 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:47,724 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:49,725 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:50,034 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:40:50,035 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:40:51,726 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:53,727 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:54,986 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:40:55,728 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:57,729 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:40:59,730 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:01,731 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:03,732 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:05,176 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:41:05,176 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:41:05,733 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:07,734 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:09,735 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:11,736 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:13,736 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:15,737 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:17,738 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:19,739 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:20,328 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:41:20,331 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:41:21,740 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:23,741 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:25,062 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:41:25,742 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:27,743 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:29,744 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:31,745 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:33,745 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:35,478 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:41:35,478 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:41:35,746 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:37,747 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:39,748 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:41,749 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:43,750 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:45,751 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:47,752 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:49,752 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:50,626 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:41:50,627 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:41:51,753 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:53,754 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:55,135 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:41:55,755 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:57,756 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:41:59,757 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:01,758 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:03,759 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:05,759 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:05,767 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:42:05,768 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:42:07,760 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:09,761 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:11,762 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:13,763 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:15,764 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:17,765 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:19,766 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:20,931 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:42:20,931 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:42:21,767 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:23,769 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:25,205 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:42:25,770 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:27,771 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:29,771 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:31,772 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:33,773 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:35,774 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:36,077 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:42:36,077 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:42:37,775 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:39,776 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:41,776 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:43,777 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:45,778 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:47,779 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:49,780 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:51,227 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:42:51,227 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:42:51,781 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:53,781 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:55,273 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:42:55,782 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:57,783 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:42:59,784 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:01,785 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:03,786 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:05,787 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:06,361 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:43:06,362 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:43:07,788 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:09,789 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:11,790 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:13,791 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:15,792 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:17,792 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:19,793 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:21,495 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:43:21,496 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:43:21,794 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:23,794 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:25,341 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:43:25,795 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:27,796 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:29,797 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:31,798 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:33,799 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:35,799 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:36,633 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:43:36,633 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:43:37,800 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:39,801 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:41,802 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:43,803 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:45,804 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:47,805 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:49,805 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:51,774 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:43:51,774 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:43:51,806 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:53,807 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:55,411 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:43:55,808 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:57,809 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:43:59,810 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:01,810 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:03,811 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:05,812 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:06,911 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:44:06,911 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:44:07,813 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:09,814 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:11,815 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:13,816 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:15,817 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:17,817 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:19,818 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:21,819 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:22,048 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:44:22,049 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:44:24,820 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:25,482 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:44:26,821 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:28,822 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:30,823 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:32,824 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:34,825 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:36,826 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:37,205 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:44:37,205 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:44:38,826 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:40,827 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:42,828 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:44,829 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:46,830 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:48,830 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:50,831 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:52,345 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:44:52,346 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:44:52,832 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:54,833 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:55,549 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:44:56,834 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:44:58,835 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:00,836 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:02,837 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:04,838 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:06,838 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:07,485 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:45:07,485 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:45:08,839 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:10,840 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:12,841 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:14,842 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:16,843 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:18,844 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:20,845 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:22,626 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:45:22,626 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:45:22,845 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:24,846 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:25,619 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:45:26,847 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:28,848 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:30,849 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:32,850 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:34,851 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:36,852 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:37,785 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:45:37,785 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:45:38,852 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:40,853 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:42,854 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:44,855 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:46,856 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:48,857 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:50,858 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:52,859 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:52,920 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:45:52,920 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:45:54,859 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:55,692 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:45:56,860 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:45:58,861 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:00,862 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:02,863 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:04,864 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:06,865 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:08,082 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:46:08,083 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:46:08,866 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:10,867 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:12,867 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:14,868 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:16,869 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:18,870 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:20,871 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:22,872 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:23,225 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:46:23,225 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:46:24,872 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:25,765 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:46:26,873 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:28,874 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:30,875 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:32,876 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:34,877 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:36,878 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:38,521 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:46:38,521 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:46:38,879 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:40,879 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:42,880 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:44,881 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:46,882 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:48,883 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:50,884 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:52,884 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:53,679 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:46:53,679 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:46:54,885 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:55,836 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:46:56,886 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:46:58,887 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:00,888 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:02,888 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:04,889 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:06,890 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:08,820 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:47:08,821 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:47:08,891 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:10,892 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:12,892 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:14,893 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:16,894 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:18,895 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:20,896 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:22,897 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:24,163 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:47:24,164 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:47:24,897 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:25,910 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:47:26,898 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:28,899 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:30,900 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:32,901 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:34,901 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:36,902 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:38,903 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:39,382 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:47:39,383 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:47:40,904 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:42,905 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:44,906 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:46,906 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:48,907 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:50,908 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:52,909 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:54,521 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:47:54,522 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:47:54,910 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:55,981 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:47:56,911 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:47:58,911 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:00,912 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:02,913 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:04,914 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:06,914 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:08,915 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:09,658 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:48:09,658 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:48:10,916 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:12,917 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:14,918 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:16,919 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:18,920 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:20,921 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:22,921 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:24,845 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:48:24,846 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:48:24,922 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:26,047 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:48:26,923 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:28,924 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:30,925 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:32,926 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:34,927 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:36,927 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:38,928 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:39,992 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:48:39,993 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:48:40,929 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:42,930 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:44,931 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:46,932 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:48,932 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:50,933 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:52,934 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:54,935 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:55,145 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:48:55,146 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:48:56,111 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:48:56,936 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:48:58,936 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:00,937 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:02,938 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:04,939 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:06,940 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:08,940 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:10,286 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:49:10,287 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:49:10,941 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:12,942 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:14,943 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:16,944 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:18,945 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:20,945 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:22,946 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:24,947 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:25,428 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:49:25,429 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:49:26,175 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:49:26,948 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:28,949 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:30,950 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:32,951 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:34,951 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:36,952 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:38,953 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:40,563 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:49:40,564 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:49:40,954 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:42,955 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:44,956 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:46,957 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:48,957 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:50,958 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:52,959 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:54,960 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:55,702 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:49:55,702 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:49:56,241 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:49:56,961 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:49:58,962 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:00,963 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:02,964 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:04,964 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:06,965 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:08,966 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:10,852 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:50:10,852 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:50:10,967 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:12,968 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:14,969 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:16,969 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:18,970 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:20,971 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:22,972 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:24,972 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:26,006 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:50:26,006 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:50:26,308 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:50:26,973 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:28,974 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:30,975 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:32,976 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:34,977 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:36,978 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:38,979 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:40,980 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:41,173 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:50:41,173 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:50:42,981 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:44,981 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:46,982 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:48,983 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:50,984 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:52,985 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:54,986 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:56,329 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:50:56,329 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:50:56,467 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:50:56,987 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:50:58,988 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:00,989 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:02,990 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:04,991 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:06,992 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:08,992 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:10,993 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:11,479 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:51:11,480 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:51:12,994 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:14,995 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:16,996 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:18,997 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:20,997 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:22,998 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:25,999 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:26,450 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:51:26,619 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:51:26,619 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:51:28,000 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:30,001 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:32,002 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:34,003 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:36,003 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:38,004 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:40,005 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:41,771 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:51:41,772 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:51:42,006 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:44,007 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:46,008 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:48,009 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:50,010 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:52,011 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:54,012 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:56,013 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:51:56,525 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:51:56,907 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:51:56,907 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:51:58,014 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:00,015 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:02,016 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:04,017 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:06,018 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:08,019 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:10,019 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:12,020 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:12,047 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:52:12,047 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:52:14,021 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:16,022 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:18,023 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:20,024 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:22,025 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:24,026 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:26,027 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:26,600 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:52:27,223 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:52:27,223 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:52:28,027 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:30,028 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:32,029 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:34,030 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:36,031 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:38,032 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:40,033 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:42,033 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:42,365 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:52:42,366 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:52:44,034 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:46,035 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:48,036 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:50,037 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:52,038 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:54,039 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:56,040 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:52:56,670 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:52:57,508 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:52:57,508 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:52:58,041 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:00,042 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:02,043 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:04,043 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:06,044 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:08,045 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:10,046 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:12,047 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:12,648 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:53:12,649 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:53:14,048 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:16,049 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:18,050 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:20,051 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:22,052 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:24,053 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:26,054 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:26,739 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:53:27,787 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:53:27,787 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:53:28,055 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:30,055 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:32,056 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:34,057 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:36,058 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:38,059 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:40,060 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:42,061 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:42,923 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:53:42,924 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:53:44,062 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:46,063 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:48,064 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:50,065 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:52,066 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:54,067 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:56,068 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:53:56,812 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:53:58,063 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:53:58,063 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:53:58,069 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:00,070 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:02,071 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:04,072 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:06,073 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:08,074 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:10,075 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:12,076 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:13,249 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:54:13,250 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:54:14,077 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:16,078 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:18,079 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:20,080 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:22,081 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:24,082 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:26,082 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:26,881 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:54:28,083 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:28,397 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:54:28,397 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:54:30,084 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:32,085 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:34,086 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:36,087 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:38,088 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:40,089 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:42,090 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:43,533 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:54:43,533 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:54:44,091 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:46,092 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:48,093 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:50,094 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:52,095 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:54,096 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:56,097 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:56,945 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:54:58,098 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:54:58,672 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:54:58,672 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:55:00,099 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:02,100 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:04,101 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:06,102 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:08,103 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:10,104 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:12,104 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:13,811 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:55:13,811 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:55:14,105 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:16,106 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:18,107 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:20,108 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:22,108 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:24,109 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:26,110 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:27,014 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:55:28,111 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:28,956 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:55:28,957 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:55:30,112 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:32,113 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:34,114 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:36,115 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:38,116 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:40,117 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:42,117 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:44,100 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:55:44,101 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:55:44,118 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:46,119 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:48,120 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:50,121 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:52,122 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:54,122 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:56,123 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:57,086 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:55:58,124 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:55:59,247 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:55:59,248 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:56:00,125 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:02,126 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:04,127 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:06,127 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:08,128 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:10,129 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:12,130 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:14,131 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:14,433 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:56:14,433 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:56:27,163 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:56:30,010 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:56:30,011 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:56:32,139 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:34,140 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:36,141 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:38,141 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:40,142 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:42,143 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:44,144 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:45,144 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:56:45,145 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:56:46,146 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:48,146 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:50,147 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:52,148 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:54,149 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:56,150 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:56:57,236 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:56:58,151 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:00,152 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:00,362 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:57:00,362 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:57:02,153 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:04,153 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:06,154 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:08,155 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:10,156 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:12,157 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:14,158 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:15,501 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:57:15,502 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:57:16,158 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:18,159 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:20,161 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:22,162 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:24,163 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:26,163 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:27,309 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:57:28,164 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:30,165 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:30,645 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:57:30,645 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:57:32,167 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:34,168 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:36,169 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:38,170 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:40,171 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:42,172 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:44,173 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:45,782 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:57:45,782 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:57:46,174 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:48,175 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:50,176 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:52,177 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:54,178 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:56,179 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:57:57,383 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:57:58,180 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:00,181 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:00,947 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:58:00,948 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:58:02,182 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:04,183 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:06,184 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:08,185 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:10,186 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:12,187 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:14,188 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:16,091 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:58:16,092 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:58:16,189 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:18,190 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:20,191 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:22,191 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:24,192 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:26,193 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:27,455 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:58:28,194 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:30,195 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:31,240 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:58:31,241 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:58:32,198 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:35,200 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:37,200 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:39,201 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:41,202 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:43,203 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:45,204 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:46,521 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:58:46,521 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:58:47,205 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:49,206 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:51,207 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:53,208 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:55,209 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:57,210 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:58:57,530 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:58:59,211 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:01,212 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:01,664 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:59:01,664 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:59:03,213 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:05,214 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:07,215 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:09,215 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:11,216 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:13,217 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:15,218 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:16,800 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:59:16,800 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:59:17,220 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:19,221 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:21,221 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:23,222 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:25,223 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:27,224 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:27,604 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:59:29,225 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:31,225 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:31,940 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:59:31,941 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:59:33,226 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:35,227 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:37,228 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:39,229 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:41,230 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:43,231 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:45,232 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:47,087 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 14:59:47,087 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 14:59:47,233 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:49,234 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:51,235 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:53,236 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:55,237 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:57,238 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 14:59:57,679 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 14:59:59,239 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:01,240 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:02,226 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:00:02,226 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:00:03,241 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:05,242 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:07,243 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:09,244 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:11,245 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:13,246 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:15,247 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:17,247 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:17,365 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:00:17,365 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:00:19,248 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:21,249 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:23,251 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:25,252 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:27,253 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:27,751 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:00:29,254 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:31,255 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:32,504 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:00:32,504 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:00:33,256 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:35,257 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:37,258 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:39,258 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:41,259 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:43,260 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:45,261 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:47,262 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:47,639 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:00:47,639 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:00:49,263 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:51,264 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:53,265 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:55,266 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:57,267 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:00:57,821 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:00:59,268 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:01,269 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:02,777 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:01:02,777 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:01:03,270 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:05,271 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:07,272 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:09,273 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:11,274 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:13,275 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:15,276 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:17,277 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:17,911 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:01:17,911 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:01:19,278 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:21,278 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:23,279 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:25,280 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:27,281 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:27,890 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:01:29,282 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:31,283 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:33,048 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:01:33,049 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:01:33,284 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:35,285 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:37,286 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:39,287 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:41,288 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:43,289 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:45,290 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:47,291 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:48,189 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:01:48,190 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:01:49,292 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:51,293 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:53,294 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:55,295 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:57,296 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:01:57,962 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:01:59,297 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:01,297 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:03,298 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:03,331 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:02:03,331 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:02:05,299 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:07,300 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:09,301 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:11,302 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:13,303 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:15,304 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:17,304 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:18,497 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:02:18,498 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:02:19,305 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:21,306 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:23,307 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:25,308 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:27,309 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:28,036 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:02:29,310 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:31,311 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:33,312 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:33,637 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:02:33,637 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:02:35,313 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:37,314 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:39,315 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:41,316 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:43,317 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:45,317 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:47,318 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:48,772 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:02:48,773 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:02:49,319 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:51,320 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:53,321 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:55,322 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:57,322 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:02:58,112 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:02:59,323 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:01,324 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:03,325 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:03,908 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:03:03,909 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:03:05,326 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:07,327 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:09,327 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:11,328 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:13,329 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:15,330 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:17,331 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:19,257 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:03:19,258 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:03:19,333 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:21,334 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:23,334 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:25,335 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:27,336 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:28,188 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:03:29,337 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:31,338 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:33,339 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:34,408 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:03:34,408 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:03:35,340 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:37,341 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:39,342 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:41,343 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:43,344 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:45,345 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:47,346 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:49,347 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:49,548 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:03:49,549 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:03:51,348 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:53,349 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:55,350 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:57,351 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:03:58,262 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:03:59,352 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:01,353 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:03,354 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:04,686 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:04:04,686 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:04:05,355 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:07,356 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:09,357 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:11,358 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:13,359 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:15,360 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:17,361 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:19,362 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:19,826 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:04:19,826 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:04:21,363 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:23,364 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:25,365 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:27,366 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:28,330 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:04:29,367 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:31,368 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:33,369 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:34,962 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:04:34,962 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:04:35,370 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:37,371 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:39,372 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:41,373 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:43,374 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:45,374 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:47,375 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:49,377 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:50,096 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:04:50,097 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:04:51,378 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:53,378 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:55,379 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:57,380 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:04:58,400 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:04:59,381 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:01,382 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:03,383 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:05,240 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:05:05,240 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:05:05,384 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:07,385 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:09,386 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:11,387 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:13,388 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:15,389 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:17,390 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:19,391 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:20,378 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:05:20,379 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:05:21,392 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:23,393 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:25,394 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:27,395 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:28,471 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:05:29,396 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:31,397 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:33,398 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:35,399 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:35,510 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:05:35,510 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:05:37,400 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:39,400 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:41,401 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:43,402 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:45,403 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:47,404 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:49,405 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:50,660 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:05:50,661 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:05:51,406 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:53,407 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:55,408 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:57,409 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:05:58,543 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:05:59,410 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:01,410 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:03,411 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:05,412 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:05,799 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:06:05,799 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:06:07,413 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:09,414 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:11,415 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:13,416 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:15,417 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:17,418 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:19,419 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:20,940 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:06:20,941 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:06:21,420 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:23,421 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:25,422 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:27,423 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:28,607 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:06:29,424 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:31,425 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:33,426 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:35,427 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:36,087 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:06:36,087 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:06:37,428 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:39,429 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:41,429 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:43,431 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:45,432 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:47,433 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:50,434 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:51,301 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:06:51,302 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:06:52,435 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:54,437 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:56,438 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:58,439 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:06:58,671 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:07:00,440 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:02,441 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:04,442 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:06,442 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:07:06,443 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:07:06,444 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:08,444 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:10,445 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:12,447 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:14,448 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:16,449 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:18,450 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:20,451 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:21,584 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:07:21,584 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:07:22,452 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:24,453 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:26,454 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:28,455 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:28,736 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:07:30,456 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:32,457 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:34,458 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:36,459 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:36,778 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:07:36,779 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:07:38,460 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:40,461 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:42,462 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:44,463 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:46,464 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:48,465 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:50,466 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:51,916 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:07:51,916 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:07:52,467 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:54,469 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:56,470 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:58,471 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:07:58,803 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:08:00,472 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:02,473 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:04,474 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:06,475 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:07,056 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:08:07,057 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:08:08,476 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:10,477 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:12,477 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:14,478 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:16,479 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:18,480 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:20,481 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:22,206 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:08:22,207 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:08:22,482 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:24,483 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:26,484 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:28,485 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:28,868 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:08:30,486 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:32,487 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:34,488 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:36,489 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:37,346 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:08:37,346 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:08:38,490 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:40,491 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:42,492 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:44,493 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:46,494 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:48,495 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:50,496 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:52,487 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:08:52,487 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:08:52,497 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:54,498 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:56,498 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:58,499 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:08:58,935 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:09:00,500 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:02,501 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:04,502 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:06,503 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:07,627 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:09:07,627 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:09:08,504 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:10,505 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:12,506 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:14,507 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:16,508 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:18,509 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:20,510 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:22,511 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:23,088 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:09:23,088 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:09:24,512 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:26,513 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:28,514 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:29,008 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:09:30,515 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:32,516 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:34,517 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:36,518 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:38,235 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:09:38,236 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:09:38,519 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:40,520 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:42,521 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:44,522 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:46,523 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:48,524 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:50,525 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:52,526 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:53,400 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:09:53,400 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:09:54,527 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:56,528 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:58,529 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:09:59,085 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:10:00,530 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:02,531 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:04,532 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:06,533 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:08,534 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:08,536 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:10:08,537 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:10:10,535 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:12,536 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:14,537 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:16,538 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:18,539 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:20,540 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:22,541 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:23,715 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:10:23,715 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:10:24,542 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:26,543 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:28,544 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:29,159 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:10:30,545 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:32,546 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:34,547 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:36,548 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:38,549 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:39,078 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:10:39,078 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:10:40,550 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:42,551 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:44,552 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:46,553 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:48,554 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:50,555 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:52,556 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:54,235 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:10:54,235 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:10:54,557 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:56,558 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:58,559 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:10:59,233 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:11:00,560 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:02,561 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:04,562 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:06,563 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:08,564 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:09,375 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:11:09,375 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:11:10,565 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:12,567 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:14,568 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:16,569 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:18,570 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:20,570 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:22,572 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:24,563 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:11:24,563 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:11:24,572 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:26,574 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:28,575 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:29,308 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:11:30,576 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:32,577 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:34,578 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:36,579 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:38,580 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:39,697 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:11:39,697 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:11:40,581 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:42,582 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:44,583 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:46,584 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:48,585 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:50,586 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:52,587 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:54,588 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:54,866 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:11:54,867 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:11:56,588 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:58,589 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:11:59,383 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:12:00,590 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:02,591 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:04,591 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:06,592 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:08,593 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:10,005 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:12:10,006 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:12:10,594 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:12,595 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:14,596 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:16,597 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:18,597 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:20,598 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:22,599 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:24,600 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:25,144 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:12:25,144 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:12:26,601 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:28,602 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:29,458 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:12:30,603 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:32,603 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:34,604 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:36,605 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:38,606 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:40,316 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: stop_status 2022-01-20 15:12:40,316 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: stop_status 2022-01-20 15:12:40,606 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:42,607 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:44,608 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:46,609 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:48,610 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:50,611 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:52,612 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:53,208 WARNING MainThread:2513451 [internal.py:wandb_internal():146] Internal process interrupt: 1 2022-01-20 15:12:54,613 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:55,902 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:55,903 DEBUG SenderThread:2513451 [sender.py:send():234] send: telemetry 2022-01-20 15:12:55,903 DEBUG SenderThread:2513451 [sender.py:send():234] send: exit 2022-01-20 15:12:55,903 INFO SenderThread:2513451 [sender.py:send_exit():366] handling exit code: 255 2022-01-20 15:12:55,903 INFO SenderThread:2513451 [sender.py:send_exit():368] handling runtime: 4565 2022-01-20 15:12:55,904 INFO SenderThread:2513451 [sender.py:_save_file():939] saving file wandb-summary.json with policy end 2022-01-20 15:12:55,904 INFO SenderThread:2513451 [sender.py:send_exit():374] send defer 2022-01-20 15:12:55,904 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:55,905 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:55,905 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 0 2022-01-20 15:12:55,905 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:55,905 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 0 2022-01-20 15:12:55,905 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 1 2022-01-20 15:12:55,905 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:55,905 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 1 2022-01-20 15:12:55,924 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:55,924 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 1 2022-01-20 15:12:55,924 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 2 2022-01-20 15:12:55,924 DEBUG SenderThread:2513451 [sender.py:send():234] send: stats 2022-01-20 15:12:55,925 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:55,925 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 2 2022-01-20 15:12:55,925 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:55,925 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 2 2022-01-20 15:12:55,925 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 3 2022-01-20 15:12:55,926 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:55,926 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 3 2022-01-20 15:12:55,926 DEBUG SenderThread:2513451 [sender.py:send():234] send: summary 2022-01-20 15:12:55,926 INFO SenderThread:2513451 [sender.py:_save_file():939] saving file wandb-summary.json with policy end 2022-01-20 15:12:55,926 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:55,926 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 3 2022-01-20 15:12:55,926 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 4 2022-01-20 15:12:55,927 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:55,927 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 4 2022-01-20 15:12:55,927 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:55,927 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 4 2022-01-20 15:12:56,006 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:56,102 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 5 2022-01-20 15:12:56,102 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:56,103 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:56,103 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 5 2022-01-20 15:12:56,103 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:56,103 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 5 2022-01-20 15:12:56,103 INFO SenderThread:2513451 [dir_watcher.py:finish():283] shutting down directory watcher 2022-01-20 15:12:56,204 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:56,614 INFO Thread-8 :2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/config.yaml 2022-01-20 15:12:56,615 INFO SenderThread:2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:56,615 INFO SenderThread:2513451 [dir_watcher.py:_on_file_modified():230] file/dir modified: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/wandb-summary.json 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():313] scan: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/config.yaml config.yaml 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/diff.patch diff.patch 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/requirements.txt requirements.txt 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log output.log 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/wandb-summary.json wandb-summary.json 2022-01-20 15:12:56,616 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/wandb-metadata.json wandb-metadata.json 2022-01-20 15:12:56,617 INFO SenderThread:2513451 [dir_watcher.py:finish():327] scan save: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/code/run_mlm_flax.py code/run_mlm_flax.py 2022-01-20 15:12:56,617 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 6 2022-01-20 15:12:56,618 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:56,622 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:56,622 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 6 2022-01-20 15:12:56,622 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:56,622 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 6 2022-01-20 15:12:56,622 INFO SenderThread:2513451 [file_pusher.py:finish():177] shutting down file pusher 2022-01-20 15:12:56,720 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:56,720 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:56,822 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:56,822 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:56,924 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:56,924 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:57,026 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:57,026 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:57,061 INFO Thread-15 :2513451 [upload_job.py:push():137] Uploaded file /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/requirements.txt 2022-01-20 15:12:57,074 INFO Thread-16 :2513451 [upload_job.py:push():137] Uploaded file /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/output.log 2022-01-20 15:12:57,078 INFO Thread-14 :2513451 [upload_job.py:push():137] Uploaded file /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/config.yaml 2022-01-20 15:12:57,084 INFO Thread-17 :2513451 [upload_job.py:push():137] Uploaded file /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/files/wandb-summary.json 2022-01-20 15:12:57,128 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:57,128 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:57,230 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:57,230 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:57,285 INFO Thread-7 :2513451 [sender.py:transition_state():387] send defer: 7 2022-01-20 15:12:57,286 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:57,286 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 7 2022-01-20 15:12:57,286 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:57,286 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 7 2022-01-20 15:12:57,332 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:57,712 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 8 2022-01-20 15:12:57,713 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:57,713 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:57,713 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 8 2022-01-20 15:12:57,714 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:57,714 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 8 2022-01-20 15:12:57,714 INFO SenderThread:2513451 [sender.py:transition_state():387] send defer: 9 2022-01-20 15:12:57,714 DEBUG SenderThread:2513451 [sender.py:send():234] send: final 2022-01-20 15:12:57,714 DEBUG SenderThread:2513451 [sender.py:send():234] send: footer 2022-01-20 15:12:57,714 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: defer 2022-01-20 15:12:57,715 INFO HandlerThread:2513451 [handler.py:handle_request_defer():147] handle defer: 9 2022-01-20 15:12:57,715 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: defer 2022-01-20 15:12:57,715 INFO SenderThread:2513451 [sender.py:send_request_defer():383] handle sender defer: 9 2022-01-20 15:12:57,814 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: poll_exit 2022-01-20 15:12:57,815 DEBUG SenderThread:2513451 [sender.py:send_request():248] send_request: poll_exit 2022-01-20 15:12:57,815 INFO SenderThread:2513451 [file_pusher.py:join():182] waiting for file pusher 2022-01-20 15:12:58,081 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: get_summary 2022-01-20 15:12:58,081 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: sampled_history 2022-01-20 15:12:58,082 DEBUG HandlerThread:2513451 [handler.py:handle_request():130] handle_request: shutdown 2022-01-20 15:12:58,082 INFO HandlerThread:2513451 [handler.py:finish():731] shutting down handler 2022-01-20 15:12:58,715 INFO WriterThread:2513451 [datastore.py:close():281] close: /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/run-r5vgtpr6.wandb 2022-01-20 15:12:59,079 INFO SenderThread:2513451 [sender.py:finish():1070] shutting down sender 2022-01-20 15:12:59,080 INFO SenderThread:2513451 [file_pusher.py:finish():177] shutting down file pusher 2022-01-20 15:12:59,080 INFO SenderThread:2513451 [file_pusher.py:join():182] waiting for file pusher 2022-01-20 15:12:59,082 INFO MainThread:2513451 [internal.py:handle_exit():77] Internal process exited