Hugging Face's logo

csujeong
/
falcon-7b-sharded-bf16-finetuned-financial

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
csujeong commited on
Commit
e49f418
•
1 Parent(s): 4f7cc10

Training in progress, step 70

Browse files
Files changed (5) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Dec23_12-50-32_e914d23c8e31/events.out.tfevents.1703335862.e914d23c8e31.1666.0 +2 -2
  3. wandb/debug-internal.log +81 -0
  4. wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json +1 -1
  5. wandb/run-20231223_125209-wzwtpkqz/logs/debug-internal.log +81 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:69906a7f3089815bd0b9cf5bbf2383b285ebea4e3270e1102298dfb1a325125a
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f607fd8097a33ff3c031055af5c44a9df34a70e6c2f5886ac00655b47ee97f7
3
  size 261131840
runs/Dec23_12-50-32_e914d23c8e31/events.out.tfevents.1703335862.e914d23c8e31.1666.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4f957ce08702b9f71b2f8cd8131c1645200113bd149ec9a706932ffa781e60a5
3
- size 6261
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fb533dceeae9511c12c5b033b7364d33f6bd4a241fd18970852fae12e5b1dd8
3
+ size 6569
wandb/debug-internal.log CHANGED
@@ -260,3 +260,84 @@
260
  2023-12-23 12:59:27,465 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
261
  2023-12-23 12:59:28,611 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
262
  2023-12-23 12:59:33,612 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
260
  2023-12-23 12:59:27,465 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
261
  2023-12-23 12:59:28,611 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
262
  2023-12-23 12:59:33,612 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
263
+ 2023-12-23 12:59:38,614 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
264
+ 2023-12-23 12:59:42,399 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
265
+ 2023-12-23 12:59:42,464 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
266
+ 2023-12-23 12:59:42,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
267
+ 2023-12-23 12:59:42,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
268
+ 2023-12-23 12:59:43,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
269
+ 2023-12-23 12:59:48,628 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
270
+ 2023-12-23 12:59:53,629 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
271
+ 2023-12-23 12:59:57,464 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
272
+ 2023-12-23 12:59:57,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
273
+ 2023-12-23 12:59:57,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
274
+ 2023-12-23 12:59:58,643 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
275
+ 2023-12-23 13:00:03,644 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
276
+ 2023-12-23 13:00:08,645 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
277
+ 2023-12-23 13:00:12,399 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
278
+ 2023-12-23 13:00:12,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
279
+ 2023-12-23 13:00:12,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
280
+ 2023-12-23 13:00:12,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
281
+ 2023-12-23 13:00:13,715 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
282
+ 2023-12-23 13:00:18,717 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
283
+ 2023-12-23 13:00:23,719 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
284
+ 2023-12-23 13:00:27,466 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
285
+ 2023-12-23 13:00:27,466 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
286
+ 2023-12-23 13:00:27,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
287
+ 2023-12-23 13:00:29,594 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
288
+ 2023-12-23 13:00:33,937 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
289
+ 2023-12-23 13:00:33,938 DEBUG SenderThread:4184 [sender.py:send():382] send: history
290
+ 2023-12-23 13:00:33,942 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
291
+ 2023-12-23 13:00:33,945 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
292
+ 2023-12-23 13:00:34,761 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
293
+ 2023-12-23 13:00:34,947 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
294
+ 2023-12-23 13:00:39,948 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
295
+ 2023-12-23 13:00:42,400 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
296
+ 2023-12-23 13:00:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
297
+ 2023-12-23 13:00:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
298
+ 2023-12-23 13:00:42,477 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
299
+ 2023-12-23 13:00:45,589 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
300
+ 2023-12-23 13:00:50,590 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
301
+ 2023-12-23 13:00:55,591 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
302
+ 2023-12-23 13:00:57,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
303
+ 2023-12-23 13:00:57,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
304
+ 2023-12-23 13:00:57,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
305
+ 2023-12-23 13:01:01,582 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
306
+ 2023-12-23 13:01:06,583 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
307
+ 2023-12-23 13:01:11,587 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
308
+ 2023-12-23 13:01:12,401 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
309
+ 2023-12-23 13:01:12,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
310
+ 2023-12-23 13:01:12,477 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
311
+ 2023-12-23 13:01:12,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
312
+ 2023-12-23 13:01:16,613 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
313
+ 2023-12-23 13:01:21,614 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
314
+ 2023-12-23 13:01:26,615 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
315
+ 2023-12-23 13:01:27,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
316
+ 2023-12-23 13:01:27,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
317
+ 2023-12-23 13:01:27,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
318
+ 2023-12-23 13:01:31,640 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
319
+ 2023-12-23 13:01:36,641 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
320
+ 2023-12-23 13:01:41,642 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
321
+ 2023-12-23 13:01:42,402 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
322
+ 2023-12-23 13:01:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
323
+ 2023-12-23 13:01:42,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
324
+ 2023-12-23 13:01:42,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
325
+ 2023-12-23 13:01:47,548 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
326
+ 2023-12-23 13:01:52,549 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
327
+ 2023-12-23 13:01:57,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
328
+ 2023-12-23 13:01:57,492 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
329
+ 2023-12-23 13:01:57,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
330
+ 2023-12-23 13:01:57,628 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
331
+ 2023-12-23 13:01:58,863 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
332
+ 2023-12-23 13:01:58,864 DEBUG SenderThread:4184 [sender.py:send():382] send: history
333
+ 2023-12-23 13:01:58,865 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
334
+ 2023-12-23 13:01:58,871 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
335
+ 2023-12-23 13:01:58,960 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
336
+ 2023-12-23 13:02:02,876 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
337
+ 2023-12-23 13:02:07,876 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
338
+ 2023-12-23 13:02:12,403 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
339
+ 2023-12-23 13:02:12,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
340
+ 2023-12-23 13:02:12,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
341
+ 2023-12-23 13:02:12,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
342
+ 2023-12-23 13:02:13,625 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
343
+ 2023-12-23 13:02:18,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.4718, "train/learning_rate": 6.601106984173835e-05, "train/epoch": 3.23, "train/global_step": 50, "_timestamp": 1703336355.269433, "_runtime": 425.3388969898224, "_step": 4}
 
1
+ {"train/loss": 0.3199, "train/learning_rate": 8.208341474624071e-06, "train/epoch": 4.52, "train/global_step": 70, "_timestamp": 1703336518.8624713, "_runtime": 588.9319353103638, "_step": 6}
wandb/run-20231223_125209-wzwtpkqz/logs/debug-internal.log CHANGED
@@ -260,3 +260,84 @@
260
  2023-12-23 12:59:27,465 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
261
  2023-12-23 12:59:28,611 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
262
  2023-12-23 12:59:33,612 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
260
  2023-12-23 12:59:27,465 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
261
  2023-12-23 12:59:28,611 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
262
  2023-12-23 12:59:33,612 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
263
+ 2023-12-23 12:59:38,614 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
264
+ 2023-12-23 12:59:42,399 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
265
+ 2023-12-23 12:59:42,464 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
266
+ 2023-12-23 12:59:42,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
267
+ 2023-12-23 12:59:42,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
268
+ 2023-12-23 12:59:43,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
269
+ 2023-12-23 12:59:48,628 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
270
+ 2023-12-23 12:59:53,629 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
271
+ 2023-12-23 12:59:57,464 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
272
+ 2023-12-23 12:59:57,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
273
+ 2023-12-23 12:59:57,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
274
+ 2023-12-23 12:59:58,643 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
275
+ 2023-12-23 13:00:03,644 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
276
+ 2023-12-23 13:00:08,645 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
277
+ 2023-12-23 13:00:12,399 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
278
+ 2023-12-23 13:00:12,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
279
+ 2023-12-23 13:00:12,465 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
280
+ 2023-12-23 13:00:12,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
281
+ 2023-12-23 13:00:13,715 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
282
+ 2023-12-23 13:00:18,717 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
283
+ 2023-12-23 13:00:23,719 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
284
+ 2023-12-23 13:00:27,466 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
285
+ 2023-12-23 13:00:27,466 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
286
+ 2023-12-23 13:00:27,466 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
287
+ 2023-12-23 13:00:29,594 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
288
+ 2023-12-23 13:00:33,937 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
289
+ 2023-12-23 13:00:33,938 DEBUG SenderThread:4184 [sender.py:send():382] send: history
290
+ 2023-12-23 13:00:33,942 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
291
+ 2023-12-23 13:00:33,945 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
292
+ 2023-12-23 13:00:34,761 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
293
+ 2023-12-23 13:00:34,947 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
294
+ 2023-12-23 13:00:39,948 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
295
+ 2023-12-23 13:00:42,400 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
296
+ 2023-12-23 13:00:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
297
+ 2023-12-23 13:00:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
298
+ 2023-12-23 13:00:42,477 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
299
+ 2023-12-23 13:00:45,589 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
300
+ 2023-12-23 13:00:50,590 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
301
+ 2023-12-23 13:00:55,591 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
302
+ 2023-12-23 13:00:57,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
303
+ 2023-12-23 13:00:57,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
304
+ 2023-12-23 13:00:57,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
305
+ 2023-12-23 13:01:01,582 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
306
+ 2023-12-23 13:01:06,583 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
307
+ 2023-12-23 13:01:11,587 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
308
+ 2023-12-23 13:01:12,401 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
309
+ 2023-12-23 13:01:12,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
310
+ 2023-12-23 13:01:12,477 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
311
+ 2023-12-23 13:01:12,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
312
+ 2023-12-23 13:01:16,613 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
313
+ 2023-12-23 13:01:21,614 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
314
+ 2023-12-23 13:01:26,615 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
315
+ 2023-12-23 13:01:27,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
316
+ 2023-12-23 13:01:27,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
317
+ 2023-12-23 13:01:27,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
318
+ 2023-12-23 13:01:31,640 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
319
+ 2023-12-23 13:01:36,641 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
320
+ 2023-12-23 13:01:41,642 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
321
+ 2023-12-23 13:01:42,402 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
322
+ 2023-12-23 13:01:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
323
+ 2023-12-23 13:01:42,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
324
+ 2023-12-23 13:01:42,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
325
+ 2023-12-23 13:01:47,548 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
326
+ 2023-12-23 13:01:52,549 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
327
+ 2023-12-23 13:01:57,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
328
+ 2023-12-23 13:01:57,492 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
329
+ 2023-12-23 13:01:57,517 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
330
+ 2023-12-23 13:01:57,628 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
331
+ 2023-12-23 13:01:58,863 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
332
+ 2023-12-23 13:01:58,864 DEBUG SenderThread:4184 [sender.py:send():382] send: history
333
+ 2023-12-23 13:01:58,865 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
334
+ 2023-12-23 13:01:58,871 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
335
+ 2023-12-23 13:01:58,960 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
336
+ 2023-12-23 13:02:02,876 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
337
+ 2023-12-23 13:02:07,876 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
338
+ 2023-12-23 13:02:12,403 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
339
+ 2023-12-23 13:02:12,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
340
+ 2023-12-23 13:02:12,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
341
+ 2023-12-23 13:02:12,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
342
+ 2023-12-23 13:02:13,625 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
343
+ 2023-12-23 13:02:18,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report