Hugging Face's logo

csujeong
/
falcon-7b-sharded-bf16-finetuned-financial

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
csujeong commited on
Commit
3e1fe06
•
1 Parent(s): e49f418

Training in progress, step 80

Browse files
Files changed (6) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Dec23_12-50-32_e914d23c8e31/events.out.tfevents.1703335862.e914d23c8e31.1666.0 +2 -2
  3. wandb/debug-internal.log +48 -0
  4. wandb/run-20231223_125209-wzwtpkqz/files/config.yaml +20 -0
  5. wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json +1 -1
  6. wandb/run-20231223_125209-wzwtpkqz/logs/debug-internal.log +48 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4f607fd8097a33ff3c031055af5c44a9df34a70e6c2f5886ac00655b47ee97f7
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ac4e806990fd6c6b6e7bdbbdf6bf88ff3856d93ae3aaf2b15091422b498e168
3
  size 261131840
runs/Dec23_12-50-32_e914d23c8e31/events.out.tfevents.1703335862.e914d23c8e31.1666.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fb533dceeae9511c12c5b033b7364d33f6bd4a241fd18970852fae12e5b1dd8
3
- size 6569
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b49d7da041be9e6b50321be8e21456cf08c6319e04530553e5e59d10b912ab31
3
+ size 7071
wandb/debug-internal.log CHANGED
@@ -341,3 +341,51 @@
341
  2023-12-23 13:02:12,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
342
  2023-12-23 13:02:13,625 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
343
  2023-12-23 13:02:18,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
341
  2023-12-23 13:02:12,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
342
  2023-12-23 13:02:13,625 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
343
  2023-12-23 13:02:18,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
344
+ 2023-12-23 13:02:23,628 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
345
+ 2023-12-23 13:02:27,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
346
+ 2023-12-23 13:02:27,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
347
+ 2023-12-23 13:02:27,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
348
+ 2023-12-23 13:02:28,631 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
349
+ 2023-12-23 13:02:33,632 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
350
+ 2023-12-23 13:02:38,633 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
351
+ 2023-12-23 13:02:42,404 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
352
+ 2023-12-23 13:02:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
353
+ 2023-12-23 13:02:42,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
354
+ 2023-12-23 13:02:42,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
355
+ 2023-12-23 13:02:44,579 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
356
+ 2023-12-23 13:02:49,579 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
357
+ 2023-12-23 13:02:54,580 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
358
+ 2023-12-23 13:02:57,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
359
+ 2023-12-23 13:02:57,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
360
+ 2023-12-23 13:02:57,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
361
+ 2023-12-23 13:02:59,599 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
362
+ 2023-12-23 13:03:04,599 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
363
+ 2023-12-23 13:03:09,600 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
364
+ 2023-12-23 13:03:12,405 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
365
+ 2023-12-23 13:03:12,478 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
366
+ 2023-12-23 13:03:12,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
367
+ 2023-12-23 13:03:12,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
368
+ 2023-12-23 13:03:15,556 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
369
+ 2023-12-23 13:03:20,557 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
370
+ 2023-12-23 13:03:21,703 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
371
+ 2023-12-23 13:03:21,705 DEBUG SenderThread:4184 [sender.py:send():382] send: history
372
+ 2023-12-23 13:03:21,706 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
373
+ 2023-12-23 13:03:21,711 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
374
+ 2023-12-23 13:03:22,245 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
375
+ 2023-12-23 13:03:25,719 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
376
+ 2023-12-23 13:03:27,478 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
377
+ 2023-12-23 13:03:27,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
378
+ 2023-12-23 13:03:27,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
379
+ 2023-12-23 13:03:28,502 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
380
+ 2023-12-23 13:03:28,504 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
381
+ 2023-12-23 13:03:28,505 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
382
+ 2023-12-23 13:03:28,505 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
383
+ 2023-12-23 13:03:28,506 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
384
+ 2023-12-23 13:03:28,506 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
385
+ 2023-12-23 13:03:28,506 DEBUG SenderThread:4184 [sender.py:send():382] send: history
386
+ 2023-12-23 13:03:28,507 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
387
+ 2023-12-23 13:03:28,512 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
388
+ 2023-12-23 13:03:29,267 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
389
+ 2023-12-23 13:03:31,515 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
390
+ 2023-12-23 13:03:36,521 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
391
+ 2023-12-23 13:03:37,292 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/config.yaml
wandb/run-20231223_125209-wzwtpkqz/files/config.yaml CHANGED
@@ -68,6 +68,26 @@ _wandb:
68
  5: 1
69
  6:
70
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
71
  vocab_size:
72
  desc: null
73
  value: 65024
 
68
  5: 1
69
  6:
70
  - 1
71
+ - 1: train/train_runtime
72
+ 5: 1
73
+ 6:
74
+ - 1
75
+ - 1: train/train_samples_per_second
76
+ 5: 1
77
+ 6:
78
+ - 1
79
+ - 1: train/train_steps_per_second
80
+ 5: 1
81
+ 6:
82
+ - 1
83
+ - 1: train/total_flos
84
+ 5: 1
85
+ 6:
86
+ - 1
87
+ - 1: train/train_loss
88
+ 5: 1
89
+ 6:
90
+ - 1
91
  vocab_size:
92
  desc: null
93
  value: 65024
wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.3199, "train/learning_rate": 8.208341474624071e-06, "train/epoch": 4.52, "train/global_step": 70, "_timestamp": 1703336518.8624713, "_runtime": 588.9319353103638, "_step": 6}
 
1
+ {"train/loss": 0.2683, "train/learning_rate": 0.0, "train/epoch": 5.16, "train/global_step": 80, "_timestamp": 1703336608.5014348, "_runtime": 678.570898771286, "_step": 8, "train/train_runtime": 746.3608, "train/train_samples_per_second": 0.429, "train/train_steps_per_second": 0.107, "train/total_flos": 1311231188610816.0, "train/train_loss": 0.6944896876811981}
wandb/run-20231223_125209-wzwtpkqz/logs/debug-internal.log CHANGED
@@ -341,3 +341,51 @@
341
  2023-12-23 13:02:12,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
342
  2023-12-23 13:02:13,625 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
343
  2023-12-23 13:02:18,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
341
  2023-12-23 13:02:12,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
342
  2023-12-23 13:02:13,625 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
343
  2023-12-23 13:02:18,627 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
344
+ 2023-12-23 13:02:23,628 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
345
+ 2023-12-23 13:02:27,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
346
+ 2023-12-23 13:02:27,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
347
+ 2023-12-23 13:02:27,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
348
+ 2023-12-23 13:02:28,631 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
349
+ 2023-12-23 13:02:33,632 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
350
+ 2023-12-23 13:02:38,633 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
351
+ 2023-12-23 13:02:42,404 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
352
+ 2023-12-23 13:02:42,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
353
+ 2023-12-23 13:02:42,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
354
+ 2023-12-23 13:02:42,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
355
+ 2023-12-23 13:02:44,579 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
356
+ 2023-12-23 13:02:49,579 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
357
+ 2023-12-23 13:02:54,580 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
358
+ 2023-12-23 13:02:57,477 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
359
+ 2023-12-23 13:02:57,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
360
+ 2023-12-23 13:02:57,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
361
+ 2023-12-23 13:02:59,599 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
362
+ 2023-12-23 13:03:04,599 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
363
+ 2023-12-23 13:03:09,600 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
364
+ 2023-12-23 13:03:12,405 DEBUG SenderThread:4184 [sender.py:send():382] send: stats
365
+ 2023-12-23 13:03:12,478 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
366
+ 2023-12-23 13:03:12,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
367
+ 2023-12-23 13:03:12,518 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
368
+ 2023-12-23 13:03:15,556 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
369
+ 2023-12-23 13:03:20,557 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
370
+ 2023-12-23 13:03:21,703 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
371
+ 2023-12-23 13:03:21,705 DEBUG SenderThread:4184 [sender.py:send():382] send: history
372
+ 2023-12-23 13:03:21,706 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
373
+ 2023-12-23 13:03:21,711 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
374
+ 2023-12-23 13:03:22,245 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
375
+ 2023-12-23 13:03:25,719 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
376
+ 2023-12-23 13:03:27,478 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: stop_status
377
+ 2023-12-23 13:03:27,478 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: stop_status
378
+ 2023-12-23 13:03:27,492 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: internal_messages
379
+ 2023-12-23 13:03:28,502 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: partial_history
380
+ 2023-12-23 13:03:28,504 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
381
+ 2023-12-23 13:03:28,505 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
382
+ 2023-12-23 13:03:28,505 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
383
+ 2023-12-23 13:03:28,506 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
384
+ 2023-12-23 13:03:28,506 DEBUG SenderThread:4184 [sender.py:send():382] send: metric
385
+ 2023-12-23 13:03:28,506 DEBUG SenderThread:4184 [sender.py:send():382] send: history
386
+ 2023-12-23 13:03:28,507 DEBUG SenderThread:4184 [sender.py:send_request():409] send_request: summary_record
387
+ 2023-12-23 13:03:28,512 INFO SenderThread:4184 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
388
+ 2023-12-23 13:03:29,267 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/wandb-summary.json
389
+ 2023-12-23 13:03:31,515 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
390
+ 2023-12-23 13:03:36,521 DEBUG HandlerThread:4184 [handler.py:handle_request():146] handle_request: status_report
391
+ 2023-12-23 13:03:37,292 INFO Thread-12 :4184 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/falcon-7b-sharded-bf16-finetuned-financial/wandb/run-20231223_125209-wzwtpkqz/files/config.yaml