2022-01-20 13:56:49,410 INFO    MainThread:2512121 [wandb_setup.py:_flush():71] setting env: {}
2022-01-20 13:56:49,410 INFO    MainThread:2512121 [wandb_setup.py:_flush():71] setting login settings: {}
2022-01-20 13:56:49,410 INFO    MainThread:2512121 [wandb_init.py:_log_setup():371] Logging user logs to /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/logs/debug.log
2022-01-20 13:56:49,410 INFO    MainThread:2512121 [wandb_init.py:_log_setup():372] Logging internal logs to /data/roberta-base-ncc-512b/wandb/run-20220120_135649-r5vgtpr6/logs/debug-internal.log
2022-01-20 13:56:49,411 INFO    MainThread:2512121 [wandb_init.py:init():404] calling init triggers
2022-01-20 13:56:49,411 INFO    MainThread:2512121 [wandb_init.py:init():409] wandb.init called with sweep_config: {}
config: {}
2022-01-20 13:56:49,411 INFO    MainThread:2512121 [wandb_init.py:init():460] starting backend
2022-01-20 13:56:49,411 INFO    MainThread:2512121 [backend.py:_multiprocessing_setup():99] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2022-01-20 13:56:49,496 INFO    MainThread:2512121 [backend.py:ensure_launched():216] starting backend process...
2022-01-20 13:56:49,551 INFO    MainThread:2512121 [backend.py:ensure_launched():221] started backend process with pid: 2513451
2022-01-20 13:56:49,553 INFO    MainThread:2512121 [wandb_init.py:init():469] backend started and connected
2022-01-20 13:56:49,563 INFO    MainThread:2512121 [wandb_init.py:init():533] updated telemetry
2022-01-20 13:56:49,695 INFO    MainThread:2512121 [wandb_init.py:init():563] communicating current version
2022-01-20 13:56:50,353 INFO    MainThread:2512121 [wandb_init.py:init():568] got version response 
2022-01-20 13:56:50,354 INFO    MainThread:2512121 [wandb_init.py:init():578] communicating run to backend with 30 second timeout
2022-01-20 13:56:50,529 INFO    MainThread:2512121 [wandb_init.py:init():606] starting run threads in backend
2022-01-20 13:56:50,687 INFO    MainThread:2512121 [wandb_run.py:_console_start():1810] atexit reg
2022-01-20 13:56:50,687 INFO    MainThread:2512121 [wandb_run.py:_redirect():1684] redirect: SettingsConsole.REDIRECT
2022-01-20 13:56:50,688 INFO    MainThread:2512121 [wandb_run.py:_redirect():1689] Redirecting console.
2022-01-20 13:56:50,690 INFO    MainThread:2512121 [wandb_run.py:_redirect():1745] Redirects installed.
2022-01-20 13:56:50,690 INFO    MainThread:2512121 [wandb_init.py:init():633] run started, returning control to user process
2022-01-20 13:56:50,690 INFO    MainThread:2512121 [wandb_run.py:_config_callback():956] config_cb None None {'output_dir': './', 'overwrite_output_dir': True, 'do_train': True, 'do_eval': True, 'per_device_train_batch_size': 46, 'per_device_eval_batch_size': 46, 'learning_rate': 0.00015, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.98, 'adam_epsilon': 1e-06, 'adafactor': False, 'num_train_epochs': 3.0, 'warmup_steps': 1000, 'logging_steps': 1000, 'save_steps': 1000, 'eval_steps': 1000, 'seed': 42, 'push_to_hub': True, 'hub_model_id': None, 'hub_token': None}
2022-01-20 13:56:50,691 INFO    MainThread:2512121 [wandb_run.py:_config_callback():956] config_cb None None {'model_name_or_path': 'versae/roberta-base-ncc', 'model_type': 'roberta', 'config_name': './', 'tokenizer_name': './', 'cache_dir': None, 'use_fast_tokenizer': True, 'dtype': 'bfloat16'}
2022-01-20 13:56:50,691 INFO    MainThread:2512121 [wandb_run.py:_config_callback():956] config_cb None None {'dataset_name': 'NbAiLab/NCC', 'dataset_config_name': None, 'train_file': None, 'validation_file': None, 'train_ref_file': None, 'validation_ref_file': None, 'overwrite_cache': False, 'validation_split_percentage': 5, 'max_seq_length': 512, 'preprocessing_num_workers': None, 'mlm_probability': 0.15, 'pad_to_max_length': True, 'line_by_line': False}
2022-01-20 15:12:53,717 INFO    MainThread:2512121 [wandb_run.py:_atexit_cleanup():1780] got exitcode: 255
2022-01-20 15:12:53,718 INFO    MainThread:2512121 [wandb_run.py:_restore():1752] restore
2022-01-20 15:12:55,905 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 2
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 37926
  total_bytes: 37926
}

2022-01-20 15:12:56,103 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 2
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 37926
  total_bytes: 37926
}

2022-01-20 15:12:56,618 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 37926
  total_bytes: 47361
}

2022-01-20 15:12:56,721 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 37926
  total_bytes: 47361
}

2022-01-20 15:12:56,823 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}

2022-01-20 15:12:56,925 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}

2022-01-20 15:12:57,027 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}

2022-01-20 15:12:57,129 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}

2022-01-20 15:12:57,231 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}

2022-01-20 15:12:57,714 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}

2022-01-20 15:12:58,080 INFO    MainThread:2512121 [wandb_run.py:_wait_for_finish():1912] got exit ret: done: true
exit_result {
}
file_counts {
  wandb_count: 6
  other_count: 1
}
pusher_stats {
  uploaded_bytes: 47361
  total_bytes: 47361
}
local_info {
}

2022-01-20 15:12:59,238 INFO    MainThread:2512121 [wandb_run.py:_append_files():2180] logging synced files