metadata
license: apache-2.0
base_model: martimfasantos/tinyllama-1.1b-sum-sft-full_old
tags:
- alignment-handbook
- trl
- dpo
- generated_from_trainer
- trl
- dpo
- generated_from_trainer
datasets:
- openai/summarize_from_feedback
model-index:
- name: tinyllama-1.1b-sum-dpo-full_LR5e-8_3epochs_old
results: []
tinyllama-1.1b-sum-dpo-full_LR5e-8_3epochs_old
This model is a fine-tuned version of martimfasantos/tinyllama-1.1b-sum-sft-full_old on the openai/summarize_from_feedback dataset. It achieves the following results on the evaluation set:
- Loss: 0.6687
- Rewards/chosen: -0.2893
- Rewards/rejected: -0.3487
- Rewards/accuracies: 0.6008
- Rewards/margins: 0.0594
- Logps/rejected: -98.0463
- Logps/chosen: -87.6427
- Logits/rejected: -2.7624
- Logits/chosen: -2.7684
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-08
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- distributed_type: multi-GPU
- gradient_accumulation_steps: 2
- total_train_batch_size: 16
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: cosine
- lr_scheduler_warmup_ratio: 0.1
- num_epochs: 3
Training results
| Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.6931 | 0.0172 | 100 | 0.6932 | -0.0000 | 0.0001 | 0.4851 | -0.0001 | -63.1729 | -58.7138 | -3.1573 | -3.1630 |
| 0.6931 | 0.0345 | 200 | 0.6932 | -0.0000 | 0.0001 | 0.4730 | -0.0001 | -63.1741 | -58.7133 | -3.1575 | -3.1631 |
| 0.6932 | 0.0517 | 300 | 0.6932 | 0.0001 | 0.0001 | 0.4942 | -0.0000 | -63.1702 | -58.7051 | -3.1574 | -3.1631 |
| 0.6932 | 0.0689 | 400 | 0.6932 | 0.0001 | 0.0001 | 0.4884 | -0.0001 | -63.1678 | -58.7049 | -3.1574 | -3.1631 |
| 0.6931 | 0.0861 | 500 | 0.6932 | -0.0000 | 0.0001 | 0.4737 | -0.0001 | -63.1733 | -58.7135 | -3.1577 | -3.1633 |
| 0.693 | 0.1034 | 600 | 0.6932 | 0.0001 | 0.0001 | 0.4923 | -0.0000 | -63.1656 | -58.7003 | -3.1575 | -3.1632 |
| 0.6932 | 0.1206 | 700 | 0.6931 | 0.0002 | 0.0002 | 0.5100 | 0.0001 | -63.1644 | -58.6897 | -3.1574 | -3.1631 |
| 0.6929 | 0.1378 | 800 | 0.6932 | 0.0002 | 0.0003 | 0.4668 | -0.0001 | -63.1484 | -58.6918 | -3.1571 | -3.1627 |
| 0.6931 | 0.1551 | 900 | 0.6931 | 0.0003 | 0.0002 | 0.5058 | 0.0000 | -63.1556 | -58.6837 | -3.1569 | -3.1625 |
| 0.6931 | 0.1723 | 1000 | 0.6931 | 0.0004 | 0.0002 | 0.5051 | 0.0001 | -63.1557 | -58.6755 | -3.1567 | -3.1624 |
| 0.6929 | 0.1895 | 1100 | 0.6931 | 0.0005 | 0.0004 | 0.5160 | 0.0001 | -63.1450 | -58.6627 | -3.1565 | -3.1621 |
| 0.6927 | 0.2068 | 1200 | 0.6930 | 0.0007 | 0.0005 | 0.5160 | 0.0002 | -63.1294 | -58.6411 | -3.1560 | -3.1616 |
| 0.6929 | 0.2240 | 1300 | 0.6930 | 0.0009 | 0.0006 | 0.5230 | 0.0003 | -63.1224 | -58.6264 | -3.1548 | -3.1605 |
| 0.692 | 0.2412 | 1400 | 0.6929 | 0.0010 | 0.0005 | 0.5407 | 0.0005 | -63.1333 | -58.6153 | -3.1542 | -3.1598 |
| 0.6918 | 0.2584 | 1500 | 0.6929 | 0.0011 | 0.0006 | 0.5351 | 0.0005 | -63.1157 | -58.5976 | -3.1532 | -3.1588 |
| 0.6921 | 0.2757 | 1600 | 0.6928 | 0.0015 | 0.0007 | 0.5611 | 0.0008 | -63.1099 | -58.5639 | -3.1517 | -3.1574 |
| 0.692 | 0.2929 | 1700 | 0.6926 | 0.0018 | 0.0008 | 0.5662 | 0.0010 | -63.1046 | -58.5339 | -3.1502 | -3.1558 |
| 0.6904 | 0.3101 | 1800 | 0.6926 | 0.0018 | 0.0007 | 0.5699 | 0.0012 | -63.1148 | -58.5277 | -3.1485 | -3.1542 |
| 0.691 | 0.3274 | 1900 | 0.6924 | 0.0018 | 0.0003 | 0.5581 | 0.0015 | -63.1539 | -58.5341 | -3.1473 | -3.1529 |
| 0.6909 | 0.3446 | 2000 | 0.6923 | 0.0020 | 0.0002 | 0.5723 | 0.0018 | -63.1632 | -58.5155 | -3.1452 | -3.1509 |
| 0.6903 | 0.3618 | 2100 | 0.6921 | 0.0019 | -0.0002 | 0.5697 | 0.0021 | -63.1963 | -58.5193 | -3.1434 | -3.1490 |
| 0.6884 | 0.3790 | 2200 | 0.6920 | 0.0018 | -0.0006 | 0.5757 | 0.0024 | -63.2422 | -58.5311 | -3.1407 | -3.1464 |
| 0.6876 | 0.3963 | 2300 | 0.6918 | 0.0015 | -0.0012 | 0.5769 | 0.0027 | -63.3015 | -58.5638 | -3.1381 | -3.1437 |
| 0.6898 | 0.4135 | 2400 | 0.6917 | 0.0012 | -0.0018 | 0.5625 | 0.0030 | -63.3619 | -58.5900 | -3.1348 | -3.1404 |
| 0.6905 | 0.4307 | 2500 | 0.6915 | 0.0007 | -0.0028 | 0.5743 | 0.0035 | -63.4609 | -58.6445 | -3.1321 | -3.1378 |
| 0.6864 | 0.4480 | 2600 | 0.6913 | -0.0001 | -0.0039 | 0.5732 | 0.0038 | -63.5690 | -58.7216 | -3.1295 | -3.1352 |
| 0.6866 | 0.4652 | 2700 | 0.6911 | -0.0014 | -0.0057 | 0.5709 | 0.0043 | -63.7456 | -58.8490 | -3.1270 | -3.1327 |
| 0.6869 | 0.4824 | 2800 | 0.6909 | -0.0025 | -0.0071 | 0.5750 | 0.0046 | -63.8913 | -58.9609 | -3.1248 | -3.1305 |
| 0.6888 | 0.4997 | 2900 | 0.6907 | -0.0042 | -0.0093 | 0.5855 | 0.0051 | -64.1121 | -59.1289 | -3.1214 | -3.1271 |
| 0.6885 | 0.5169 | 3000 | 0.6905 | -0.0061 | -0.0118 | 0.5804 | 0.0057 | -64.3621 | -59.3245 | -3.1180 | -3.1236 |
| 0.686 | 0.5341 | 3100 | 0.6904 | -0.0071 | -0.0130 | 0.5857 | 0.0059 | -64.4774 | -59.4209 | -3.1160 | -3.1217 |
| 0.6869 | 0.5513 | 3200 | 0.6902 | -0.0095 | -0.0159 | 0.5878 | 0.0064 | -64.7659 | -59.6584 | -3.1119 | -3.1176 |
| 0.6834 | 0.5686 | 3300 | 0.6900 | -0.0122 | -0.0190 | 0.5809 | 0.0068 | -65.0782 | -59.9308 | -3.1072 | -3.1130 |
| 0.6795 | 0.5858 | 3400 | 0.6897 | -0.0147 | -0.0221 | 0.5881 | 0.0074 | -65.3901 | -60.1840 | -3.1036 | -3.1093 |
| 0.6848 | 0.6030 | 3500 | 0.6895 | -0.0171 | -0.0250 | 0.5897 | 0.0079 | -65.6826 | -60.4227 | -3.1007 | -3.1064 |
| 0.6834 | 0.6203 | 3600 | 0.6893 | -0.0196 | -0.0280 | 0.5857 | 0.0084 | -65.9796 | -60.6710 | -3.0969 | -3.1026 |
| 0.6788 | 0.6375 | 3700 | 0.6890 | -0.0219 | -0.0308 | 0.5813 | 0.0089 | -66.2620 | -60.8999 | -3.0922 | -3.0979 |
| 0.6825 | 0.6547 | 3800 | 0.6888 | -0.0253 | -0.0348 | 0.5904 | 0.0095 | -66.6623 | -61.2404 | -3.0889 | -3.0946 |
| 0.6791 | 0.6720 | 3900 | 0.6885 | -0.0287 | -0.0389 | 0.5943 | 0.0103 | -67.0740 | -61.5806 | -3.0858 | -3.0915 |
| 0.6816 | 0.6892 | 4000 | 0.6881 | -0.0328 | -0.0438 | 0.5897 | 0.0110 | -67.5621 | -61.9903 | -3.0815 | -3.0872 |
| 0.6749 | 0.7064 | 4100 | 0.6879 | -0.0340 | -0.0456 | 0.5901 | 0.0116 | -67.7361 | -62.1084 | -3.0755 | -3.0812 |
| 0.6839 | 0.7236 | 4200 | 0.6877 | -0.0364 | -0.0484 | 0.5964 | 0.0120 | -68.0226 | -62.3546 | -3.0712 | -3.0769 |
| 0.6827 | 0.7409 | 4300 | 0.6876 | -0.0377 | -0.0500 | 0.5897 | 0.0123 | -68.1844 | -62.4844 | -3.0675 | -3.0732 |
| 0.6815 | 0.7581 | 4400 | 0.6873 | -0.0402 | -0.0531 | 0.5950 | 0.0129 | -68.4913 | -62.7319 | -3.0645 | -3.0702 |
| 0.6829 | 0.7753 | 4500 | 0.6870 | -0.0443 | -0.0578 | 0.5939 | 0.0136 | -68.9615 | -63.1372 | -3.0609 | -3.0666 |
| 0.6747 | 0.7926 | 4600 | 0.6868 | -0.0476 | -0.0617 | 0.5915 | 0.0141 | -69.3541 | -63.4724 | -3.0573 | -3.0630 |
| 0.6828 | 0.8098 | 4700 | 0.6864 | -0.0518 | -0.0669 | 0.5936 | 0.0151 | -69.8725 | -63.8948 | -3.0542 | -3.0599 |
| 0.6821 | 0.8270 | 4800 | 0.6861 | -0.0560 | -0.0717 | 0.5939 | 0.0156 | -70.3462 | -64.3141 | -3.0504 | -3.0562 |
| 0.6767 | 0.8442 | 4900 | 0.6858 | -0.0602 | -0.0766 | 0.5948 | 0.0164 | -70.8421 | -64.7344 | -3.0474 | -3.0532 |
| 0.6765 | 0.8615 | 5000 | 0.6856 | -0.0618 | -0.0786 | 0.5934 | 0.0168 | -71.0357 | -64.8873 | -3.0427 | -3.0484 |
| 0.6792 | 0.8787 | 5100 | 0.6853 | -0.0665 | -0.0841 | 0.5936 | 0.0176 | -71.5851 | -65.3618 | -3.0385 | -3.0443 |
| 0.6753 | 0.8959 | 5200 | 0.6851 | -0.0697 | -0.0877 | 0.5929 | 0.0180 | -71.9544 | -65.6814 | -3.0354 | -3.0413 |
| 0.6749 | 0.9132 | 5300 | 0.6849 | -0.0732 | -0.0918 | 0.5922 | 0.0186 | -72.3637 | -66.0356 | -3.0313 | -3.0370 |
| 0.6762 | 0.9304 | 5400 | 0.6846 | -0.0747 | -0.0940 | 0.5932 | 0.0192 | -72.5755 | -66.1839 | -3.0282 | -3.0340 |
| 0.6757 | 0.9476 | 5500 | 0.6845 | -0.0761 | -0.0955 | 0.5962 | 0.0194 | -72.7312 | -66.3251 | -3.0247 | -3.0305 |
| 0.6795 | 0.9649 | 5600 | 0.6844 | -0.0758 | -0.0955 | 0.6018 | 0.0197 | -72.7251 | -66.2887 | -3.0221 | -3.0279 |
| 0.6736 | 0.9821 | 5700 | 0.6842 | -0.0786 | -0.0989 | 0.6008 | 0.0202 | -73.0675 | -66.5758 | -3.0181 | -3.0239 |
| 0.6701 | 0.9993 | 5800 | 0.6839 | -0.0831 | -0.1040 | 0.6029 | 0.0209 | -73.5774 | -67.0210 | -3.0139 | -3.0198 |
| 0.6725 | 1.0165 | 5900 | 0.6836 | -0.0839 | -0.1053 | 0.6039 | 0.0214 | -73.7143 | -67.1023 | -3.0090 | -3.0148 |
| 0.6742 | 1.0338 | 6000 | 0.6834 | -0.0850 | -0.1069 | 0.6043 | 0.0219 | -73.8738 | -67.2139 | -3.0056 | -3.0114 |
| 0.6712 | 1.0510 | 6100 | 0.6833 | -0.0878 | -0.1100 | 0.6046 | 0.0223 | -74.1846 | -67.4874 | -3.0008 | -3.0066 |
| 0.675 | 1.0682 | 6200 | 0.6831 | -0.0903 | -0.1131 | 0.6043 | 0.0228 | -74.4897 | -67.7427 | -2.9969 | -3.0027 |
| 0.6766 | 1.0855 | 6300 | 0.6828 | -0.0936 | -0.1170 | 0.6036 | 0.0234 | -74.8753 | -68.0717 | -2.9936 | -2.9994 |
| 0.6754 | 1.1027 | 6400 | 0.6826 | -0.0972 | -0.1212 | 0.6094 | 0.0240 | -75.2993 | -68.4308 | -2.9896 | -2.9954 |
| 0.6769 | 1.1199 | 6500 | 0.6823 | -0.0999 | -0.1244 | 0.6059 | 0.0246 | -75.6244 | -68.6977 | -2.9850 | -2.9909 |
| 0.6764 | 1.1371 | 6600 | 0.6821 | -0.1041 | -0.1293 | 0.6076 | 0.0252 | -76.1111 | -69.1214 | -2.9809 | -2.9867 |
| 0.6734 | 1.1544 | 6700 | 0.6817 | -0.1081 | -0.1341 | 0.6022 | 0.0260 | -76.5930 | -69.5220 | -2.9770 | -2.9828 |
| 0.6654 | 1.1716 | 6800 | 0.6814 | -0.1138 | -0.1407 | 0.6053 | 0.0268 | -77.2464 | -70.0935 | -2.9716 | -2.9774 |
| 0.679 | 1.1888 | 6900 | 0.6812 | -0.1168 | -0.1441 | 0.6090 | 0.0272 | -77.5858 | -70.3942 | -2.9678 | -2.9737 |
| 0.6652 | 1.2061 | 7000 | 0.6809 | -0.1215 | -0.1495 | 0.6057 | 0.0280 | -78.1280 | -70.8571 | -2.9641 | -2.9700 |
| 0.6668 | 1.2233 | 7100 | 0.6808 | -0.1224 | -0.1507 | 0.6071 | 0.0283 | -78.2466 | -70.9482 | -2.9603 | -2.9661 |
| 0.6655 | 1.2405 | 7200 | 0.6806 | -0.1254 | -0.1542 | 0.6083 | 0.0288 | -78.5984 | -71.2532 | -2.9555 | -2.9614 |
| 0.6783 | 1.2578 | 7300 | 0.6804 | -0.1273 | -0.1565 | 0.6087 | 0.0292 | -78.8264 | -71.4380 | -2.9521 | -2.9580 |
| 0.6703 | 1.2750 | 7400 | 0.6802 | -0.1295 | -0.1593 | 0.6071 | 0.0297 | -79.1055 | -71.6647 | -2.9497 | -2.9555 |
| 0.6709 | 1.2922 | 7500 | 0.6802 | -0.1302 | -0.1601 | 0.6080 | 0.0299 | -79.1917 | -71.7369 | -2.9461 | -2.9519 |
| 0.6774 | 1.3094 | 7600 | 0.6799 | -0.1334 | -0.1639 | 0.6097 | 0.0305 | -79.5669 | -72.0519 | -2.9409 | -2.9468 |
| 0.6667 | 1.3267 | 7700 | 0.6796 | -0.1379 | -0.1690 | 0.6078 | 0.0311 | -80.0833 | -72.5013 | -2.9364 | -2.9423 |
| 0.6631 | 1.3439 | 7800 | 0.6793 | -0.1427 | -0.1747 | 0.6076 | 0.0321 | -80.6536 | -72.9770 | -2.9325 | -2.9384 |
| 0.6734 | 1.3611 | 7900 | 0.6790 | -0.1469 | -0.1797 | 0.6094 | 0.0327 | -81.1455 | -73.4038 | -2.9286 | -2.9346 |
| 0.6646 | 1.3784 | 8000 | 0.6786 | -0.1515 | -0.1852 | 0.6092 | 0.0337 | -81.6967 | -73.8575 | -2.9249 | -2.9308 |
| 0.6717 | 1.3956 | 8100 | 0.6783 | -0.1560 | -0.1904 | 0.6111 | 0.0344 | -82.2197 | -74.3164 | -2.9212 | -2.9271 |
| 0.6674 | 1.4128 | 8200 | 0.6779 | -0.1608 | -0.1962 | 0.6087 | 0.0354 | -82.7997 | -74.7964 | -2.9181 | -2.9240 |
| 0.6659 | 1.4300 | 8300 | 0.6779 | -0.1625 | -0.1979 | 0.6087 | 0.0354 | -82.9745 | -74.9664 | -2.9143 | -2.9202 |
| 0.6642 | 1.4473 | 8400 | 0.6777 | -0.1647 | -0.2007 | 0.6092 | 0.0360 | -83.2477 | -75.1821 | -2.9110 | -2.9169 |
| 0.6579 | 1.4645 | 8500 | 0.6775 | -0.1650 | -0.2013 | 0.6080 | 0.0363 | -83.3130 | -75.2138 | -2.9067 | -2.9125 |
| 0.6725 | 1.4817 | 8600 | 0.6774 | -0.1676 | -0.2043 | 0.6101 | 0.0367 | -83.6107 | -75.4718 | -2.9030 | -2.9089 |
| 0.6646 | 1.4990 | 8700 | 0.6774 | -0.1665 | -0.2032 | 0.6101 | 0.0367 | -83.4985 | -75.3618 | -2.9012 | -2.9071 |
| 0.6681 | 1.5162 | 8800 | 0.6771 | -0.1691 | -0.2064 | 0.6092 | 0.0373 | -83.8169 | -75.6183 | -2.8978 | -2.9037 |
| 0.6635 | 1.5334 | 8900 | 0.6768 | -0.1758 | -0.2138 | 0.6087 | 0.0381 | -84.5617 | -76.2875 | -2.8935 | -2.8994 |
| 0.6509 | 1.5507 | 9000 | 0.6766 | -0.1793 | -0.2180 | 0.6092 | 0.0386 | -84.9755 | -76.6455 | -2.8897 | -2.8956 |
| 0.663 | 1.5679 | 9100 | 0.6764 | -0.1824 | -0.2216 | 0.6073 | 0.0391 | -85.3355 | -76.9553 | -2.8858 | -2.8918 |
| 0.6614 | 1.5851 | 9200 | 0.6762 | -0.1856 | -0.2252 | 0.6076 | 0.0396 | -85.7006 | -77.2724 | -2.8834 | -2.8894 |
| 0.6605 | 1.6023 | 9300 | 0.6761 | -0.1847 | -0.2246 | 0.6078 | 0.0398 | -85.6352 | -77.1840 | -2.8793 | -2.8852 |
| 0.6616 | 1.6196 | 9400 | 0.6759 | -0.1879 | -0.2282 | 0.6053 | 0.0403 | -86.0049 | -77.5025 | -2.8759 | -2.8818 |
| 0.6595 | 1.6368 | 9500 | 0.6757 | -0.1905 | -0.2315 | 0.6085 | 0.0410 | -86.3271 | -77.7626 | -2.8721 | -2.8781 |
| 0.6612 | 1.6540 | 9600 | 0.6753 | -0.1938 | -0.2356 | 0.6069 | 0.0418 | -86.7373 | -78.0935 | -2.8679 | -2.8738 |
| 0.6563 | 1.6713 | 9700 | 0.6751 | -0.1979 | -0.2402 | 0.6083 | 0.0423 | -87.2033 | -78.5057 | -2.8649 | -2.8708 |
| 0.6526 | 1.6885 | 9800 | 0.6750 | -0.2017 | -0.2444 | 0.6069 | 0.0427 | -87.6160 | -78.8784 | -2.8620 | -2.8680 |
| 0.6392 | 1.7057 | 9900 | 0.6747 | -0.2051 | -0.2485 | 0.6094 | 0.0434 | -88.0276 | -79.2194 | -2.8594 | -2.8653 |
| 0.6528 | 1.7229 | 10000 | 0.6746 | -0.2062 | -0.2500 | 0.6087 | 0.0437 | -88.1775 | -79.3360 | -2.8562 | -2.8622 |
| 0.6542 | 1.7402 | 10100 | 0.6744 | -0.2075 | -0.2516 | 0.6066 | 0.0441 | -88.3364 | -79.4595 | -2.8532 | -2.8592 |
| 0.6559 | 1.7574 | 10200 | 0.6739 | -0.2141 | -0.2595 | 0.6078 | 0.0454 | -89.1350 | -80.1233 | -2.8483 | -2.8543 |
| 0.6708 | 1.7746 | 10300 | 0.6737 | -0.2171 | -0.2629 | 0.6104 | 0.0458 | -89.4692 | -80.4205 | -2.8439 | -2.8500 |
| 0.6454 | 1.7919 | 10400 | 0.6737 | -0.2178 | -0.2638 | 0.6048 | 0.0460 | -89.5570 | -80.4903 | -2.8419 | -2.8479 |
| 0.6495 | 1.8091 | 10500 | 0.6735 | -0.2211 | -0.2676 | 0.6036 | 0.0465 | -89.9389 | -80.8204 | -2.8383 | -2.8444 |
| 0.6648 | 1.8263 | 10600 | 0.6732 | -0.2247 | -0.2719 | 0.6034 | 0.0472 | -90.3731 | -81.1833 | -2.8349 | -2.8409 |
| 0.6568 | 1.8436 | 10700 | 0.6731 | -0.2275 | -0.2752 | 0.6039 | 0.0476 | -90.6979 | -81.4662 | -2.8311 | -2.8372 |
| 0.6536 | 1.8608 | 10800 | 0.6728 | -0.2303 | -0.2785 | 0.6043 | 0.0482 | -91.0335 | -81.7461 | -2.8295 | -2.8355 |
| 0.6574 | 1.8780 | 10900 | 0.6726 | -0.2320 | -0.2808 | 0.6032 | 0.0487 | -91.2560 | -81.9128 | -2.8271 | -2.8331 |
| 0.6601 | 1.8952 | 11000 | 0.6725 | -0.2331 | -0.2820 | 0.6018 | 0.0489 | -91.3829 | -82.0227 | -2.8250 | -2.8311 |
| 0.6562 | 1.9125 | 11100 | 0.6722 | -0.2383 | -0.2881 | 0.6029 | 0.0498 | -91.9931 | -82.5429 | -2.8218 | -2.8278 |
| 0.6536 | 1.9297 | 11200 | 0.6720 | -0.2416 | -0.2919 | 0.6025 | 0.0503 | -92.3716 | -82.8687 | -2.8187 | -2.8248 |
| 0.674 | 1.9469 | 11300 | 0.6718 | -0.2432 | -0.2940 | 0.6041 | 0.0508 | -92.5781 | -83.0317 | -2.8164 | -2.8225 |
| 0.6536 | 1.9642 | 11400 | 0.6717 | -0.2439 | -0.2949 | 0.6032 | 0.0511 | -92.6723 | -83.0980 | -2.8133 | -2.8194 |
| 0.6693 | 1.9814 | 11500 | 0.6717 | -0.2456 | -0.2969 | 0.6018 | 0.0513 | -92.8725 | -83.2765 | -2.8119 | -2.8179 |
| 0.6529 | 1.9986 | 11600 | 0.6714 | -0.2469 | -0.2988 | 0.6036 | 0.0518 | -93.0569 | -83.4057 | -2.8097 | -2.8158 |
| 0.6454 | 2.0159 | 11700 | 0.6713 | -0.2488 | -0.3010 | 0.6025 | 0.0522 | -93.2831 | -83.5962 | -2.8079 | -2.8140 |
| 0.6643 | 2.0331 | 11800 | 0.6711 | -0.2513 | -0.3040 | 0.6027 | 0.0527 | -93.5825 | -83.8399 | -2.8052 | -2.8113 |
| 0.6478 | 2.0503 | 11900 | 0.6710 | -0.2554 | -0.3084 | 0.5985 | 0.0530 | -94.0157 | -84.2502 | -2.8025 | -2.8086 |
| 0.6512 | 2.0675 | 12000 | 0.6708 | -0.2561 | -0.3095 | 0.6050 | 0.0535 | -94.1316 | -84.3177 | -2.8001 | -2.8061 |
| 0.6517 | 2.0848 | 12100 | 0.6708 | -0.2574 | -0.3109 | 0.6053 | 0.0536 | -94.2719 | -84.4484 | -2.7988 | -2.8048 |
| 0.646 | 2.1020 | 12200 | 0.6707 | -0.2592 | -0.3130 | 0.6025 | 0.0538 | -94.4818 | -84.6297 | -2.7972 | -2.8033 |
| 0.6439 | 2.1192 | 12300 | 0.6706 | -0.2607 | -0.3147 | 0.6029 | 0.0540 | -94.6511 | -84.7795 | -2.7953 | -2.8014 |
| 0.6432 | 2.1365 | 12400 | 0.6705 | -0.2646 | -0.3191 | 0.6053 | 0.0545 | -95.0945 | -85.1767 | -2.7925 | -2.7985 |
| 0.6437 | 2.1537 | 12500 | 0.6704 | -0.2662 | -0.3209 | 0.6018 | 0.0548 | -95.2735 | -85.3289 | -2.7907 | -2.7968 |
| 0.6581 | 2.1709 | 12600 | 0.6702 | -0.2678 | -0.3229 | 0.6029 | 0.0552 | -95.4749 | -85.4889 | -2.7888 | -2.7948 |
| 0.6509 | 2.1881 | 12700 | 0.6700 | -0.2692 | -0.3248 | 0.6036 | 0.0556 | -95.6598 | -85.6304 | -2.7870 | -2.7930 |
| 0.6603 | 2.2054 | 12800 | 0.6700 | -0.2697 | -0.3254 | 0.6004 | 0.0557 | -95.7213 | -85.6830 | -2.7854 | -2.7914 |
| 0.6459 | 2.2226 | 12900 | 0.6700 | -0.2702 | -0.3259 | 0.6027 | 0.0556 | -95.7675 | -85.7359 | -2.7844 | -2.7904 |
| 0.6501 | 2.2398 | 13000 | 0.6698 | -0.2723 | -0.3285 | 0.6011 | 0.0562 | -96.0266 | -85.9425 | -2.7827 | -2.7887 |
| 0.6452 | 2.2571 | 13100 | 0.6698 | -0.2721 | -0.3282 | 0.6025 | 0.0561 | -96.0042 | -85.9225 | -2.7811 | -2.7872 |
| 0.6553 | 2.2743 | 13200 | 0.6697 | -0.2732 | -0.3296 | 0.6034 | 0.0564 | -96.1360 | -86.0296 | -2.7798 | -2.7859 |
| 0.6627 | 2.2915 | 13300 | 0.6697 | -0.2745 | -0.3311 | 0.6020 | 0.0566 | -96.2910 | -86.1636 | -2.7781 | -2.7842 |
| 0.6393 | 2.3088 | 13400 | 0.6697 | -0.2741 | -0.3307 | 0.6013 | 0.0566 | -96.2503 | -86.1255 | -2.7777 | -2.7838 |
| 0.6366 | 2.3260 | 13500 | 0.6696 | -0.2757 | -0.3325 | 0.6027 | 0.0568 | -96.4266 | -86.2794 | -2.7767 | -2.7827 |
| 0.6522 | 2.3432 | 13600 | 0.6696 | -0.2765 | -0.3334 | 0.6032 | 0.0569 | -96.5202 | -86.3612 | -2.7753 | -2.7814 |
| 0.6535 | 2.3604 | 13700 | 0.6695 | -0.2780 | -0.3351 | 0.6022 | 0.0572 | -96.6946 | -86.5112 | -2.7742 | -2.7802 |
| 0.6555 | 2.3777 | 13800 | 0.6694 | -0.2786 | -0.3360 | 0.6022 | 0.0574 | -96.7815 | -86.5683 | -2.7734 | -2.7795 |
| 0.6658 | 2.3949 | 13900 | 0.6694 | -0.2781 | -0.3355 | 0.6032 | 0.0574 | -96.7320 | -86.5236 | -2.7727 | -2.7788 |
| 0.6453 | 2.4121 | 14000 | 0.6693 | -0.2789 | -0.3364 | 0.6018 | 0.0575 | -96.8240 | -86.6049 | -2.7718 | -2.7778 |
| 0.6451 | 2.4294 | 14100 | 0.6692 | -0.2797 | -0.3375 | 0.6034 | 0.0578 | -96.9303 | -86.6776 | -2.7708 | -2.7769 |
| 0.636 | 2.4466 | 14200 | 0.6693 | -0.2803 | -0.3378 | 0.6008 | 0.0576 | -96.9631 | -86.7390 | -2.7706 | -2.7766 |
| 0.6251 | 2.4638 | 14300 | 0.6691 | -0.2812 | -0.3393 | 0.6011 | 0.0581 | -97.1110 | -86.8353 | -2.7697 | -2.7757 |
| 0.6517 | 2.4810 | 14400 | 0.6691 | -0.2827 | -0.3409 | 0.6025 | 0.0583 | -97.2740 | -86.9799 | -2.7687 | -2.7747 |
| 0.633 | 2.4983 | 14500 | 0.6690 | -0.2837 | -0.3422 | 0.6006 | 0.0585 | -97.3994 | -87.0852 | -2.7680 | -2.7740 |
| 0.6407 | 2.5155 | 14600 | 0.6690 | -0.2842 | -0.3426 | 0.6011 | 0.0584 | -97.4438 | -87.1331 | -2.7679 | -2.7739 |
| 0.6298 | 2.5327 | 14700 | 0.6690 | -0.2853 | -0.3438 | 0.6013 | 0.0584 | -97.5570 | -87.2438 | -2.7671 | -2.7731 |
| 0.6432 | 2.5500 | 14800 | 0.6690 | -0.2862 | -0.3447 | 0.6018 | 0.0585 | -97.6493 | -87.3336 | -2.7663 | -2.7723 |
| 0.6492 | 2.5672 | 14900 | 0.6689 | -0.2866 | -0.3453 | 0.6013 | 0.0587 | -97.7090 | -87.3695 | -2.7660 | -2.7721 |
| 0.65 | 2.5844 | 15000 | 0.6689 | -0.2870 | -0.3457 | 0.6011 | 0.0587 | -97.7523 | -87.4156 | -2.7655 | -2.7715 |
| 0.6519 | 2.6017 | 15100 | 0.6689 | -0.2874 | -0.3462 | 0.6008 | 0.0588 | -97.8011 | -87.4534 | -2.7657 | -2.7718 |
| 0.6308 | 2.6189 | 15200 | 0.6689 | -0.2880 | -0.3469 | 0.6011 | 0.0589 | -97.8694 | -87.5090 | -2.7649 | -2.7709 |
| 0.6465 | 2.6361 | 15300 | 0.6689 | -0.2880 | -0.3469 | 0.6025 | 0.0589 | -97.8726 | -87.5095 | -2.7649 | -2.7710 |
| 0.6609 | 2.6533 | 15400 | 0.6688 | -0.2883 | -0.3473 | 0.6025 | 0.0590 | -97.9052 | -87.5417 | -2.7643 | -2.7703 |
| 0.6597 | 2.6706 | 15500 | 0.6688 | -0.2883 | -0.3474 | 0.6022 | 0.0591 | -97.9180 | -87.5395 | -2.7639 | -2.7700 |
| 0.6491 | 2.6878 | 15600 | 0.6687 | -0.2885 | -0.3479 | 0.6034 | 0.0593 | -97.9666 | -87.5668 | -2.7639 | -2.7700 |
| 0.6423 | 2.7050 | 15700 | 0.6687 | -0.2885 | -0.3477 | 0.6008 | 0.0592 | -97.9538 | -87.5659 | -2.7638 | -2.7699 |
| 0.6405 | 2.7223 | 15800 | 0.6687 | -0.2886 | -0.3479 | 0.6018 | 0.0593 | -97.9676 | -87.5701 | -2.7633 | -2.7694 |
| 0.6457 | 2.7395 | 15900 | 0.6687 | -0.2889 | -0.3481 | 0.6020 | 0.0592 | -97.9878 | -87.5970 | -2.7633 | -2.7694 |
| 0.6549 | 2.7567 | 16000 | 0.6687 | -0.2888 | -0.3481 | 0.6032 | 0.0593 | -97.9933 | -87.5928 | -2.7630 | -2.7692 |
| 0.6288 | 2.7739 | 16100 | 0.6688 | -0.2889 | -0.3481 | 0.6050 | 0.0592 | -97.9868 | -87.6035 | -2.7631 | -2.7692 |
| 0.6431 | 2.7912 | 16200 | 0.6688 | -0.2892 | -0.3484 | 0.6022 | 0.0592 | -98.0221 | -87.6322 | -2.7633 | -2.7694 |
| 0.6499 | 2.8084 | 16300 | 0.6687 | -0.2893 | -0.3485 | 0.6032 | 0.0593 | -98.0337 | -87.6372 | -2.7627 | -2.7688 |
| 0.6524 | 2.8256 | 16400 | 0.6687 | -0.2892 | -0.3486 | 0.6013 | 0.0594 | -98.0451 | -87.6369 | -2.7630 | -2.7690 |
| 0.6545 | 2.8429 | 16500 | 0.6687 | -0.2892 | -0.3486 | 0.6039 | 0.0594 | -98.0392 | -87.6310 | -2.7631 | -2.7691 |
| 0.6692 | 2.8601 | 16600 | 0.6688 | -0.2894 | -0.3485 | 0.6022 | 0.0591 | -98.0347 | -87.6520 | -2.7624 | -2.7686 |
| 0.6587 | 2.8773 | 16700 | 0.6687 | -0.2895 | -0.3489 | 0.6011 | 0.0594 | -98.0697 | -87.6612 | -2.7623 | -2.7684 |
| 0.6612 | 2.8946 | 16800 | 0.6687 | -0.2890 | -0.3484 | 0.6055 | 0.0593 | -98.0176 | -87.6163 | -2.7631 | -2.7692 |
| 0.6561 | 2.9118 | 16900 | 0.6688 | -0.2893 | -0.3485 | 0.6020 | 0.0592 | -98.0284 | -87.6390 | -2.7627 | -2.7688 |
| 0.6548 | 2.9290 | 17000 | 0.6688 | -0.2892 | -0.3483 | 0.6006 | 0.0591 | -98.0120 | -87.6341 | -2.7624 | -2.7684 |
| 0.6468 | 2.9462 | 17100 | 0.6687 | -0.2892 | -0.3485 | 0.6029 | 0.0593 | -98.0333 | -87.6348 | -2.7623 | -2.7683 |
| 0.666 | 2.9635 | 17200 | 0.6686 | -0.2892 | -0.3486 | 0.6029 | 0.0594 | -98.0413 | -87.6310 | -2.7622 | -2.7683 |
| 0.6571 | 2.9807 | 17300 | 0.6687 | -0.2893 | -0.3485 | 0.6039 | 0.0592 | -98.0332 | -87.6411 | -2.7624 | -2.7684 |
| 0.6414 | 2.9979 | 17400 | 0.6687 | -0.2893 | -0.3487 | 0.6008 | 0.0594 | -98.0463 | -87.6427 | -2.7624 | -2.7684 |
Framework versions
- Transformers 4.41.2
- Pytorch 2.1.2
- Datasets 2.19.2
- Tokenizers 0.19.1