--- library_name: transformers license: apache-2.0 base_model: facebook/detr-resnet-50 tags: - object-detection - vision - generated_from_trainer model-index: - name: detr-finetuned-cppe-5-10k-steps results: [] --- # detr-finetuned-cppe-5-10k-steps This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset. It achieves the following results on the evaluation set: - Loss: 1.2399 - Map: 0.296 - Map 50: 0.5758 - Map 75: 0.258 - Map Small: 0.0949 - Map Medium: 0.2452 - Map Large: 0.4635 - Mar 1: 0.2979 - Mar 10: 0.4713 - Mar 100: 0.4813 - Mar Small: 0.2026 - Mar Medium: 0.4228 - Mar Large: 0.6701 - Map Coverall: 0.5371 - Mar 100 Coverall: 0.6878 - Map Face Shield: 0.2634 - Mar 100 Face Shield: 0.4785 - Map Gloves: 0.2261 - Mar 100 Gloves: 0.4201 - Map Goggles: 0.1544 - Mar 100 Goggles: 0.3954 - Map Mask: 0.299 - Mar 100 Mask: 0.4249 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 1337 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments - lr_scheduler_type: linear - num_epochs: 100.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask | |:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:| | 3.1413 | 1.0 | 107 | 2.5672 | 0.0222 | 0.0515 | 0.0183 | 0.0012 | 0.0167 | 0.0238 | 0.0482 | 0.112 | 0.1464 | 0.0328 | 0.1046 | 0.1847 | 0.1017 | 0.4509 | 0.0 | 0.0 | 0.0037 | 0.1125 | 0.0 | 0.0 | 0.0058 | 0.1684 | | 2.1763 | 2.0 | 214 | 2.3691 | 0.0418 | 0.0978 | 0.03 | 0.0093 | 0.0232 | 0.0481 | 0.0632 | 0.14 | 0.1706 | 0.0603 | 0.1211 | 0.2081 | 0.1796 | 0.5027 | 0.0 | 0.0 | 0.0065 | 0.1835 | 0.0 | 0.0 | 0.0228 | 0.1667 | | 2.033 | 3.0 | 321 | 2.1971 | 0.051 | 0.1174 | 0.0452 | 0.0081 | 0.0458 | 0.0551 | 0.07 | 0.1497 | 0.1775 | 0.0554 | 0.1426 | 0.2071 | 0.2186 | 0.4986 | 0.0 | 0.0 | 0.012 | 0.2089 | 0.0 | 0.0 | 0.0241 | 0.18 | | 1.9673 | 4.0 | 428 | 2.2385 | 0.0525 | 0.1271 | 0.0364 | 0.0103 | 0.0458 | 0.0576 | 0.0808 | 0.1604 | 0.1836 | 0.0529 | 0.1426 | 0.2078 | 0.1835 | 0.5311 | 0.0013 | 0.0139 | 0.023 | 0.1839 | 0.0 | 0.0 | 0.0547 | 0.1889 | | 1.8638 | 5.0 | 535 | 2.1170 | 0.0726 | 0.1604 | 0.0617 | 0.0172 | 0.0471 | 0.0866 | 0.0858 | 0.1729 | 0.1906 | 0.0584 | 0.1324 | 0.238 | 0.2801 | 0.5338 | 0.0077 | 0.0506 | 0.0272 | 0.1795 | 0.0 | 0.0 | 0.0478 | 0.1889 | | 1.7537 | 6.0 | 642 | 1.8691 | 0.0996 | 0.2181 | 0.082 | 0.0343 | 0.0784 | 0.1225 | 0.1125 | 0.2125 | 0.2296 | 0.0823 | 0.1789 | 0.2897 | 0.3412 | 0.5608 | 0.0062 | 0.0848 | 0.0431 | 0.2576 | 0.0 | 0.0 | 0.1076 | 0.2449 | | 1.8525 | 7.0 | 749 | 1.9352 | 0.0883 | 0.1972 | 0.0729 | 0.0162 | 0.0604 | 0.1131 | 0.0985 | 0.1901 | 0.2068 | 0.0537 | 0.1505 | 0.277 | 0.321 | 0.5514 | 0.004 | 0.0595 | 0.0186 | 0.1683 | 0.0 | 0.0 | 0.0981 | 0.2547 | | 1.7128 | 8.0 | 856 | 2.0212 | 0.0902 | 0.2058 | 0.0703 | 0.026 | 0.0967 | 0.1188 | 0.1292 | 0.2362 | 0.2487 | 0.0897 | 0.2289 | 0.3068 | 0.2383 | 0.4662 | 0.0293 | 0.2051 | 0.0422 | 0.1955 | 0.01 | 0.0723 | 0.1312 | 0.3044 | | 1.6811 | 9.0 | 963 | 1.8181 | 0.1123 | 0.2626 | 0.0793 | 0.0414 | 0.1039 | 0.1486 | 0.1474 | 0.2796 | 0.3016 | 0.1084 | 0.2635 | 0.3804 | 0.3228 | 0.5851 | 0.0444 | 0.243 | 0.0537 | 0.2612 | 0.0055 | 0.1262 | 0.1354 | 0.2924 | | 1.5809 | 10.0 | 1070 | 1.8683 | 0.1227 | 0.2838 | 0.0904 | 0.0536 | 0.106 | 0.1514 | 0.1464 | 0.2618 | 0.2856 | 0.1016 | 0.2436 | 0.3584 | 0.3417 | 0.5712 | 0.0665 | 0.2557 | 0.0441 | 0.2478 | 0.0089 | 0.0585 | 0.1525 | 0.2951 | | 1.5978 | 11.0 | 1177 | 1.7746 | 0.1169 | 0.2736 | 0.0897 | 0.0278 | 0.0922 | 0.1677 | 0.143 | 0.2665 | 0.2851 | 0.0903 | 0.2138 | 0.4063 | 0.3609 | 0.5932 | 0.0394 | 0.2051 | 0.0447 | 0.2241 | 0.0116 | 0.1431 | 0.1279 | 0.26 | | 1.5157 | 12.0 | 1284 | 1.7348 | 0.1261 | 0.2961 | 0.0899 | 0.0398 | 0.0923 | 0.1887 | 0.1445 | 0.2861 | 0.3027 | 0.1129 | 0.2438 | 0.4051 | 0.3806 | 0.555 | 0.0643 | 0.3 | 0.044 | 0.2545 | 0.0052 | 0.1323 | 0.1363 | 0.272 | | 1.4842 | 13.0 | 1391 | 1.6683 | 0.1459 | 0.3258 | 0.1245 | 0.0497 | 0.1165 | 0.2135 | 0.1808 | 0.333 | 0.3509 | 0.1028 | 0.2823 | 0.4944 | 0.4019 | 0.6036 | 0.0706 | 0.2987 | 0.0556 | 0.271 | 0.0121 | 0.2462 | 0.1894 | 0.3351 | | 1.4971 | 14.0 | 1498 | 1.8224 | 0.1376 | 0.3065 | 0.1079 | 0.0544 | 0.102 | 0.201 | 0.1601 | 0.2728 | 0.2865 | 0.1007 | 0.2205 | 0.4186 | 0.3695 | 0.5486 | 0.0501 | 0.2076 | 0.0497 | 0.2125 | 0.0215 | 0.1523 | 0.1971 | 0.3116 | | 1.4884 | 15.0 | 1605 | 1.6449 | 0.1567 | 0.3398 | 0.1244 | 0.0575 | 0.1118 | 0.2375 | 0.1708 | 0.3298 | 0.3492 | 0.1181 | 0.2709 | 0.5033 | 0.4296 | 0.6149 | 0.0709 | 0.3165 | 0.0662 | 0.2884 | 0.0101 | 0.1846 | 0.2068 | 0.3418 | | 1.4714 | 16.0 | 1712 | 1.6947 | 0.1451 | 0.3108 | 0.1146 | 0.0384 | 0.1007 | 0.2271 | 0.1673 | 0.3191 | 0.3475 | 0.1298 | 0.2767 | 0.5012 | 0.4384 | 0.6541 | 0.063 | 0.3089 | 0.0542 | 0.2799 | 0.0067 | 0.2062 | 0.1631 | 0.2884 | | 1.4282 | 17.0 | 1819 | 1.6426 | 0.1489 | 0.3459 | 0.1074 | 0.0545 | 0.1174 | 0.2215 | 0.176 | 0.3311 | 0.3488 | 0.1237 | 0.2875 | 0.4835 | 0.3759 | 0.5806 | 0.082 | 0.2608 | 0.0737 | 0.3246 | 0.0206 | 0.2538 | 0.1923 | 0.324 | | 1.401 | 18.0 | 1926 | 1.6453 | 0.1623 | 0.3508 | 0.1355 | 0.0404 | 0.1236 | 0.2432 | 0.1947 | 0.3464 | 0.3572 | 0.1363 | 0.286 | 0.5063 | 0.4247 | 0.6194 | 0.0808 | 0.3101 | 0.0892 | 0.2902 | 0.0189 | 0.2523 | 0.198 | 0.3142 | | 1.3853 | 19.0 | 2033 | 1.6557 | 0.1625 | 0.364 | 0.1221 | 0.0429 | 0.1351 | 0.2452 | 0.1883 | 0.3572 | 0.3791 | 0.1265 | 0.3225 | 0.5293 | 0.3997 | 0.6027 | 0.0739 | 0.338 | 0.1018 | 0.3281 | 0.0223 | 0.2723 | 0.2149 | 0.3542 | | 1.3623 | 20.0 | 2140 | 1.5289 | 0.1714 | 0.3623 | 0.1442 | 0.0628 | 0.1307 | 0.255 | 0.1846 | 0.3604 | 0.3811 | 0.1259 | 0.3197 | 0.5249 | 0.4419 | 0.6631 | 0.0922 | 0.3709 | 0.0966 | 0.3161 | 0.0104 | 0.2077 | 0.2158 | 0.3476 | | 1.3285 | 21.0 | 2247 | 1.5132 | 0.1702 | 0.3673 | 0.1336 | 0.0684 | 0.1297 | 0.2644 | 0.1868 | 0.366 | 0.3789 | 0.1566 | 0.3097 | 0.5341 | 0.4426 | 0.6509 | 0.0996 | 0.3899 | 0.0908 | 0.2906 | 0.0151 | 0.2385 | 0.203 | 0.3244 | | 1.3149 | 22.0 | 2354 | 1.4973 | 0.1811 | 0.3975 | 0.1431 | 0.0654 | 0.148 | 0.272 | 0.2062 | 0.3738 | 0.3921 | 0.1473 | 0.3242 | 0.5597 | 0.4239 | 0.6405 | 0.1129 | 0.3557 | 0.1112 | 0.317 | 0.0213 | 0.2923 | 0.236 | 0.3551 | | 1.3068 | 23.0 | 2461 | 1.4898 | 0.177 | 0.3899 | 0.1367 | 0.0688 | 0.1308 | 0.2934 | 0.1963 | 0.3586 | 0.3792 | 0.1551 | 0.3026 | 0.5689 | 0.4363 | 0.6455 | 0.1079 | 0.3038 | 0.1159 | 0.3192 | 0.0137 | 0.2908 | 0.2111 | 0.3369 | | 1.2989 | 24.0 | 2568 | 1.5076 | 0.1798 | 0.4009 | 0.14 | 0.0721 | 0.1432 | 0.2728 | 0.1963 | 0.3758 | 0.4003 | 0.1595 | 0.343 | 0.5591 | 0.4407 | 0.6541 | 0.091 | 0.3266 | 0.1228 | 0.3705 | 0.0225 | 0.3046 | 0.2223 | 0.3458 | | 1.2774 | 25.0 | 2675 | 1.4761 | 0.1836 | 0.3988 | 0.151 | 0.0584 | 0.1545 | 0.2718 | 0.2089 | 0.3823 | 0.4049 | 0.2009 | 0.3468 | 0.5419 | 0.457 | 0.645 | 0.095 | 0.3519 | 0.1143 | 0.354 | 0.0281 | 0.32 | 0.2236 | 0.3533 | | 1.2854 | 26.0 | 2782 | 1.4837 | 0.183 | 0.3948 | 0.1453 | 0.0562 | 0.143 | 0.2978 | 0.2086 | 0.3706 | 0.39 | 0.1384 | 0.3259 | 0.5593 | 0.4526 | 0.6617 | 0.0929 | 0.3494 | 0.1228 | 0.3607 | 0.0288 | 0.2415 | 0.218 | 0.3369 | | 1.2664 | 27.0 | 2889 | 1.4817 | 0.1854 | 0.3881 | 0.15 | 0.0674 | 0.1359 | 0.3007 | 0.2194 | 0.3635 | 0.3848 | 0.1468 | 0.3192 | 0.5599 | 0.441 | 0.6351 | 0.1261 | 0.343 | 0.1203 | 0.3603 | 0.0206 | 0.2385 | 0.2189 | 0.3471 | | 1.2362 | 28.0 | 2996 | 1.5092 | 0.1895 | 0.4105 | 0.1573 | 0.0664 | 0.1529 | 0.2986 | 0.2278 | 0.3784 | 0.3927 | 0.1304 | 0.3329 | 0.5668 | 0.4319 | 0.6315 | 0.1316 | 0.3595 | 0.1424 | 0.3607 | 0.0227 | 0.2677 | 0.219 | 0.344 | | 1.2433 | 29.0 | 3103 | 1.5012 | 0.173 | 0.3884 | 0.124 | 0.0487 | 0.1368 | 0.2585 | 0.2016 | 0.3509 | 0.3601 | 0.1423 | 0.2913 | 0.4978 | 0.4395 | 0.595 | 0.0937 | 0.3354 | 0.1109 | 0.3054 | 0.0136 | 0.2308 | 0.2073 | 0.3338 | | 1.221 | 30.0 | 3210 | 1.4452 | 0.1939 | 0.4169 | 0.1656 | 0.0769 | 0.1538 | 0.2959 | 0.2181 | 0.372 | 0.3802 | 0.1333 | 0.3207 | 0.5319 | 0.4588 | 0.6437 | 0.1116 | 0.3582 | 0.1265 | 0.2996 | 0.0285 | 0.2508 | 0.2442 | 0.3489 | | 1.1826 | 31.0 | 3317 | 1.4250 | 0.2024 | 0.4309 | 0.1642 | 0.0577 | 0.1592 | 0.32 | 0.2186 | 0.3952 | 0.4116 | 0.1439 | 0.3663 | 0.5764 | 0.4798 | 0.6779 | 0.1187 | 0.3696 | 0.1517 | 0.3455 | 0.0314 | 0.3123 | 0.2304 | 0.3524 | | 1.2067 | 32.0 | 3424 | 1.4167 | 0.1991 | 0.4379 | 0.144 | 0.0729 | 0.1628 | 0.3051 | 0.2248 | 0.3895 | 0.4076 | 0.2067 | 0.3476 | 0.5385 | 0.4682 | 0.6518 | 0.1416 | 0.3595 | 0.1252 | 0.3384 | 0.0301 | 0.3338 | 0.2302 | 0.3547 | | 1.1873 | 33.0 | 3531 | 1.4461 | 0.1935 | 0.4322 | 0.143 | 0.0748 | 0.1479 | 0.3049 | 0.217 | 0.3865 | 0.4044 | 0.1737 | 0.3478 | 0.5585 | 0.4472 | 0.6315 | 0.0929 | 0.3696 | 0.1704 | 0.3429 | 0.0355 | 0.3585 | 0.2215 | 0.3196 | | 1.1774 | 34.0 | 3638 | 1.4112 | 0.2036 | 0.4482 | 0.1642 | 0.0695 | 0.1481 | 0.3243 | 0.2318 | 0.3955 | 0.4051 | 0.1743 | 0.3449 | 0.5468 | 0.4832 | 0.6631 | 0.1264 | 0.3975 | 0.1389 | 0.3281 | 0.0363 | 0.3 | 0.2332 | 0.3369 | | 1.1894 | 35.0 | 3745 | 1.4219 | 0.213 | 0.4398 | 0.1839 | 0.0646 | 0.1641 | 0.3189 | 0.2258 | 0.3885 | 0.4009 | 0.1443 | 0.3434 | 0.567 | 0.4973 | 0.673 | 0.1232 | 0.3291 | 0.153 | 0.3562 | 0.0402 | 0.3046 | 0.2515 | 0.3418 | | 1.1719 | 36.0 | 3852 | 1.3858 | 0.2075 | 0.43 | 0.1761 | 0.0632 | 0.1567 | 0.3405 | 0.2291 | 0.3966 | 0.4078 | 0.1714 | 0.3427 | 0.5842 | 0.4981 | 0.6883 | 0.1098 | 0.3696 | 0.1647 | 0.3554 | 0.0362 | 0.2785 | 0.2286 | 0.3471 | | 1.1191 | 37.0 | 3959 | 1.4685 | 0.1947 | 0.413 | 0.1557 | 0.0639 | 0.147 | 0.3064 | 0.2115 | 0.3668 | 0.3791 | 0.1312 | 0.3394 | 0.5027 | 0.4546 | 0.6514 | 0.1321 | 0.3177 | 0.1435 | 0.3491 | 0.0262 | 0.2415 | 0.2174 | 0.3356 | | 1.1376 | 38.0 | 4066 | 1.3801 | 0.2095 | 0.4365 | 0.1706 | 0.0729 | 0.1621 | 0.3205 | 0.2337 | 0.3964 | 0.4109 | 0.1773 | 0.352 | 0.5531 | 0.4944 | 0.6734 | 0.1034 | 0.3582 | 0.1508 | 0.3679 | 0.0556 | 0.3015 | 0.2435 | 0.3533 | | 1.1187 | 39.0 | 4173 | 1.3977 | 0.2118 | 0.4348 | 0.1743 | 0.0573 | 0.1632 | 0.3241 | 0.2316 | 0.4068 | 0.4213 | 0.1385 | 0.3542 | 0.6066 | 0.492 | 0.677 | 0.1317 | 0.3987 | 0.1563 | 0.3442 | 0.0329 | 0.3369 | 0.2461 | 0.3498 | | 1.1005 | 40.0 | 4280 | 1.4000 | 0.2183 | 0.4578 | 0.1804 | 0.0648 | 0.1627 | 0.3479 | 0.234 | 0.4057 | 0.4236 | 0.1818 | 0.356 | 0.5934 | 0.496 | 0.6788 | 0.1287 | 0.3911 | 0.1675 | 0.3683 | 0.0411 | 0.32 | 0.2581 | 0.3596 | | 1.1131 | 41.0 | 4387 | 1.3965 | 0.2196 | 0.4648 | 0.186 | 0.0615 | 0.1652 | 0.352 | 0.2429 | 0.4085 | 0.4233 | 0.1522 | 0.3668 | 0.5934 | 0.4985 | 0.6743 | 0.1333 | 0.3709 | 0.1737 | 0.3656 | 0.0434 | 0.3431 | 0.2492 | 0.3627 | | 1.0952 | 42.0 | 4494 | 1.3614 | 0.2211 | 0.4568 | 0.1837 | 0.0791 | 0.1889 | 0.3373 | 0.236 | 0.4192 | 0.4331 | 0.18 | 0.3991 | 0.5683 | 0.5185 | 0.682 | 0.1322 | 0.4114 | 0.1665 | 0.3714 | 0.0418 | 0.3354 | 0.2466 | 0.3653 | | 1.0869 | 43.0 | 4601 | 1.3947 | 0.214 | 0.4677 | 0.1768 | 0.0648 | 0.1666 | 0.3402 | 0.2263 | 0.4023 | 0.4138 | 0.1509 | 0.3593 | 0.5697 | 0.4982 | 0.6468 | 0.1428 | 0.4291 | 0.1653 | 0.3415 | 0.0417 | 0.3031 | 0.2222 | 0.3484 | | 1.0787 | 44.0 | 4708 | 1.3556 | 0.2245 | 0.467 | 0.1869 | 0.0561 | 0.1729 | 0.3474 | 0.2474 | 0.4212 | 0.4368 | 0.1737 | 0.3889 | 0.6009 | 0.5125 | 0.6779 | 0.1332 | 0.4177 | 0.1801 | 0.3871 | 0.0402 | 0.32 | 0.2565 | 0.3813 | | 1.0596 | 45.0 | 4815 | 1.3947 | 0.2369 | 0.4907 | 0.1976 | 0.0707 | 0.1735 | 0.3883 | 0.2502 | 0.4183 | 0.4325 | 0.1603 | 0.3719 | 0.6108 | 0.5126 | 0.6608 | 0.1574 | 0.4228 | 0.188 | 0.3638 | 0.066 | 0.3477 | 0.2602 | 0.3676 | | 1.0826 | 46.0 | 4922 | 1.4612 | 0.208 | 0.4644 | 0.1612 | 0.0643 | 0.1703 | 0.3207 | 0.2345 | 0.3899 | 0.4046 | 0.1531 | 0.355 | 0.5565 | 0.4677 | 0.6315 | 0.12 | 0.3671 | 0.1762 | 0.3491 | 0.0452 | 0.3308 | 0.2308 | 0.3444 | | 1.0805 | 47.0 | 5029 | 1.3511 | 0.2227 | 0.4615 | 0.1878 | 0.0642 | 0.1708 | 0.375 | 0.2433 | 0.4212 | 0.437 | 0.1386 | 0.3853 | 0.6146 | 0.5022 | 0.6739 | 0.1304 | 0.4253 | 0.1903 | 0.3821 | 0.0631 | 0.34 | 0.2275 | 0.3636 | | 1.0771 | 48.0 | 5136 | 1.3661 | 0.2354 | 0.4877 | 0.2058 | 0.0745 | 0.1712 | 0.3831 | 0.2569 | 0.4247 | 0.437 | 0.1426 | 0.375 | 0.6206 | 0.508 | 0.6856 | 0.1561 | 0.4203 | 0.1792 | 0.3737 | 0.067 | 0.3369 | 0.2669 | 0.3684 | | 1.0628 | 49.0 | 5243 | 1.3718 | 0.2257 | 0.4696 | 0.1882 | 0.0666 | 0.1704 | 0.3716 | 0.2495 | 0.4194 | 0.4389 | 0.1565 | 0.3915 | 0.6076 | 0.517 | 0.6856 | 0.1506 | 0.4468 | 0.1632 | 0.3812 | 0.0448 | 0.3046 | 0.2529 | 0.376 | | 1.027 | 50.0 | 5350 | 1.3364 | 0.2191 | 0.4542 | 0.1799 | 0.0547 | 0.1651 | 0.3593 | 0.2381 | 0.4246 | 0.4389 | 0.1632 | 0.385 | 0.5987 | 0.522 | 0.6856 | 0.1332 | 0.443 | 0.1737 | 0.3955 | 0.0446 | 0.3138 | 0.2221 | 0.3564 | | 1.0418 | 51.0 | 5457 | 1.3681 | 0.2369 | 0.4783 | 0.195 | 0.0641 | 0.1763 | 0.3895 | 0.2596 | 0.4307 | 0.4484 | 0.1748 | 0.3867 | 0.626 | 0.5177 | 0.6712 | 0.167 | 0.4278 | 0.1996 | 0.3826 | 0.0542 | 0.3846 | 0.2461 | 0.3756 | | 1.0249 | 52.0 | 5564 | 1.3403 | 0.2343 | 0.4805 | 0.1894 | 0.0595 | 0.1842 | 0.3862 | 0.2507 | 0.4277 | 0.441 | 0.1404 | 0.3939 | 0.6093 | 0.511 | 0.6599 | 0.1725 | 0.4392 | 0.1738 | 0.354 | 0.0614 | 0.3692 | 0.2526 | 0.3827 | | 1.0091 | 53.0 | 5671 | 1.3439 | 0.2291 | 0.4832 | 0.1974 | 0.0653 | 0.1841 | 0.3715 | 0.2557 | 0.4301 | 0.445 | 0.1686 | 0.4035 | 0.6129 | 0.5162 | 0.6784 | 0.142 | 0.4278 | 0.1797 | 0.3754 | 0.052 | 0.3477 | 0.2556 | 0.3956 | | 1.0185 | 54.0 | 5778 | 1.3464 | 0.236 | 0.4899 | 0.1981 | 0.0784 | 0.1762 | 0.3833 | 0.2564 | 0.4278 | 0.4451 | 0.159 | 0.3862 | 0.6195 | 0.5223 | 0.6874 | 0.1754 | 0.4329 | 0.1766 | 0.3812 | 0.0477 | 0.3446 | 0.2577 | 0.3791 | | 1.002 | 55.0 | 5885 | 1.3273 | 0.2397 | 0.5027 | 0.2123 | 0.0706 | 0.1783 | 0.4007 | 0.262 | 0.4312 | 0.4432 | 0.151 | 0.3825 | 0.6209 | 0.5223 | 0.6865 | 0.1774 | 0.443 | 0.1857 | 0.3741 | 0.0574 | 0.3262 | 0.2555 | 0.3862 | | 0.9966 | 56.0 | 5992 | 1.3200 | 0.2411 | 0.5005 | 0.1882 | 0.0878 | 0.1812 | 0.4035 | 0.2553 | 0.4318 | 0.4459 | 0.2299 | 0.3699 | 0.6179 | 0.5224 | 0.677 | 0.1827 | 0.4456 | 0.1869 | 0.3884 | 0.0847 | 0.3554 | 0.2289 | 0.3631 | | 0.9794 | 57.0 | 6099 | 1.3284 | 0.2498 | 0.5009 | 0.2216 | 0.0781 | 0.1934 | 0.4007 | 0.2653 | 0.4302 | 0.443 | 0.1738 | 0.3822 | 0.6232 | 0.5308 | 0.7018 | 0.19 | 0.4228 | 0.1929 | 0.3621 | 0.0746 | 0.3431 | 0.2607 | 0.3853 | | 1.0153 | 58.0 | 6206 | 1.3197 | 0.2536 | 0.5145 | 0.2171 | 0.078 | 0.2042 | 0.4004 | 0.275 | 0.4442 | 0.4588 | 0.1375 | 0.397 | 0.657 | 0.5125 | 0.6856 | 0.1862 | 0.4506 | 0.1927 | 0.3875 | 0.1011 | 0.3738 | 0.2753 | 0.3964 | | 0.9602 | 59.0 | 6313 | 1.2911 | 0.2552 | 0.5334 | 0.2117 | 0.0739 | 0.2123 | 0.4031 | 0.2659 | 0.435 | 0.4489 | 0.1789 | 0.4037 | 0.6197 | 0.531 | 0.686 | 0.1922 | 0.4291 | 0.1926 | 0.3705 | 0.099 | 0.3662 | 0.2611 | 0.3924 | | 0.972 | 60.0 | 6420 | 1.2744 | 0.2603 | 0.5274 | 0.2143 | 0.0811 | 0.2118 | 0.4104 | 0.2669 | 0.4441 | 0.4606 | 0.2039 | 0.4078 | 0.6325 | 0.5301 | 0.6883 | 0.189 | 0.462 | 0.208 | 0.4045 | 0.1011 | 0.3492 | 0.2735 | 0.3991 | | 0.9554 | 61.0 | 6527 | 1.3204 | 0.26 | 0.5405 | 0.222 | 0.0885 | 0.2028 | 0.4086 | 0.2648 | 0.4356 | 0.4484 | 0.1653 | 0.3894 | 0.6299 | 0.5376 | 0.6919 | 0.1997 | 0.4519 | 0.1799 | 0.3571 | 0.0969 | 0.3508 | 0.2858 | 0.3902 | | 0.9409 | 62.0 | 6634 | 1.3063 | 0.2531 | 0.5388 | 0.2049 | 0.077 | 0.2004 | 0.4041 | 0.263 | 0.4347 | 0.4482 | 0.1751 | 0.3891 | 0.6224 | 0.5131 | 0.6743 | 0.1969 | 0.4456 | 0.1894 | 0.3732 | 0.0927 | 0.3508 | 0.2735 | 0.3969 | | 0.9692 | 63.0 | 6741 | 1.3074 | 0.2522 | 0.5361 | 0.2037 | 0.0766 | 0.1991 | 0.4112 | 0.2517 | 0.4435 | 0.4561 | 0.176 | 0.3976 | 0.6311 | 0.5317 | 0.6914 | 0.1913 | 0.4532 | 0.2006 | 0.4 | 0.0854 | 0.3692 | 0.252 | 0.3667 | | 0.9391 | 64.0 | 6848 | 1.3006 | 0.2571 | 0.5233 | 0.2144 | 0.0743 | 0.2098 | 0.4183 | 0.2613 | 0.4439 | 0.4579 | 0.1965 | 0.4005 | 0.6377 | 0.5309 | 0.6896 | 0.1905 | 0.4506 | 0.1945 | 0.3951 | 0.0973 | 0.3677 | 0.2724 | 0.3867 | | 0.9332 | 65.0 | 6955 | 1.2621 | 0.2599 | 0.5177 | 0.2177 | 0.0728 | 0.2141 | 0.4172 | 0.2786 | 0.4613 | 0.4748 | 0.2141 | 0.4338 | 0.6329 | 0.5287 | 0.6892 | 0.2085 | 0.4709 | 0.1822 | 0.4085 | 0.1052 | 0.3938 | 0.2747 | 0.4116 | | 0.9279 | 66.0 | 7062 | 1.2837 | 0.2539 | 0.5219 | 0.2076 | 0.077 | 0.2045 | 0.4055 | 0.2681 | 0.4441 | 0.459 | 0.173 | 0.3982 | 0.6455 | 0.5309 | 0.6937 | 0.1965 | 0.4608 | 0.1829 | 0.3879 | 0.0852 | 0.3569 | 0.2742 | 0.3956 | | 0.9376 | 67.0 | 7169 | 1.2944 | 0.2589 | 0.5241 | 0.2166 | 0.0773 | 0.2102 | 0.4181 | 0.277 | 0.4434 | 0.4589 | 0.1887 | 0.4041 | 0.6343 | 0.5295 | 0.6793 | 0.2006 | 0.4519 | 0.1909 | 0.4054 | 0.101 | 0.3615 | 0.2726 | 0.3964 | | 0.9361 | 68.0 | 7276 | 1.3035 | 0.2623 | 0.5402 | 0.2119 | 0.0789 | 0.2189 | 0.4159 | 0.2807 | 0.4494 | 0.4643 | 0.1988 | 0.4179 | 0.6294 | 0.5236 | 0.6734 | 0.1949 | 0.4494 | 0.2046 | 0.4161 | 0.1056 | 0.3769 | 0.2826 | 0.4058 | | 0.921 | 69.0 | 7383 | 1.2813 | 0.2732 | 0.5391 | 0.2305 | 0.085 | 0.2224 | 0.4243 | 0.2703 | 0.4524 | 0.466 | 0.2096 | 0.4196 | 0.6282 | 0.5322 | 0.6797 | 0.2234 | 0.4633 | 0.209 | 0.4062 | 0.1064 | 0.3692 | 0.295 | 0.4116 | | 0.9013 | 70.0 | 7490 | 1.3099 | 0.2688 | 0.5346 | 0.223 | 0.0741 | 0.2163 | 0.4203 | 0.2732 | 0.4447 | 0.4579 | 0.1724 | 0.4066 | 0.6318 | 0.5329 | 0.6748 | 0.2094 | 0.4481 | 0.215 | 0.4027 | 0.0994 | 0.3646 | 0.2873 | 0.3996 | | 0.9154 | 71.0 | 7597 | 1.2681 | 0.2728 | 0.5379 | 0.2291 | 0.0808 | 0.2241 | 0.4265 | 0.2743 | 0.445 | 0.4563 | 0.1687 | 0.4044 | 0.633 | 0.535 | 0.6788 | 0.2228 | 0.4532 | 0.2104 | 0.3911 | 0.11 | 0.3615 | 0.286 | 0.3969 | | 0.8979 | 72.0 | 7704 | 1.2593 | 0.269 | 0.5354 | 0.2264 | 0.0722 | 0.2152 | 0.4356 | 0.2752 | 0.4583 | 0.4686 | 0.1889 | 0.427 | 0.6399 | 0.5304 | 0.677 | 0.2063 | 0.4544 | 0.1968 | 0.4009 | 0.1263 | 0.4092 | 0.2852 | 0.4013 | | 0.8901 | 73.0 | 7811 | 1.2819 | 0.2656 | 0.5447 | 0.2306 | 0.0831 | 0.2037 | 0.4385 | 0.2656 | 0.4402 | 0.4524 | 0.1725 | 0.3957 | 0.6449 | 0.5208 | 0.6878 | 0.2185 | 0.4443 | 0.1941 | 0.3942 | 0.1169 | 0.3477 | 0.2775 | 0.388 | | 0.8943 | 74.0 | 7918 | 1.2786 | 0.268 | 0.5412 | 0.2261 | 0.0806 | 0.2127 | 0.4294 | 0.2696 | 0.4506 | 0.4598 | 0.1709 | 0.4042 | 0.6454 | 0.5438 | 0.6779 | 0.2051 | 0.4722 | 0.192 | 0.3915 | 0.1189 | 0.3631 | 0.2804 | 0.3942 | | 0.8789 | 75.0 | 8025 | 1.2746 | 0.2772 | 0.5569 | 0.2291 | 0.0829 | 0.226 | 0.4355 | 0.276 | 0.4553 | 0.4666 | 0.1862 | 0.4155 | 0.6381 | 0.5432 | 0.6901 | 0.2387 | 0.4759 | 0.2011 | 0.3884 | 0.1214 | 0.3846 | 0.2817 | 0.3938 | | 0.877 | 76.0 | 8132 | 1.2574 | 0.2757 | 0.5538 | 0.2251 | 0.0852 | 0.2285 | 0.4347 | 0.2706 | 0.4565 | 0.4684 | 0.1859 | 0.4177 | 0.6485 | 0.5329 | 0.6856 | 0.2301 | 0.4759 | 0.2069 | 0.3978 | 0.1224 | 0.3785 | 0.2865 | 0.4044 | | 0.8764 | 77.0 | 8239 | 1.2568 | 0.2776 | 0.5465 | 0.2391 | 0.0777 | 0.2323 | 0.4377 | 0.2747 | 0.4574 | 0.4707 | 0.1812 | 0.4223 | 0.646 | 0.5331 | 0.6815 | 0.2196 | 0.4759 | 0.2148 | 0.3996 | 0.1202 | 0.3785 | 0.3001 | 0.4182 | | 0.878 | 78.0 | 8346 | 1.2859 | 0.2726 | 0.5531 | 0.2368 | 0.0729 | 0.2235 | 0.4329 | 0.2742 | 0.4495 | 0.4608 | 0.1963 | 0.4066 | 0.6355 | 0.5247 | 0.6739 | 0.225 | 0.4557 | 0.2081 | 0.4071 | 0.1183 | 0.3631 | 0.287 | 0.404 | | 0.8631 | 79.0 | 8453 | 1.2818 | 0.2792 | 0.5567 | 0.2261 | 0.0776 | 0.2267 | 0.4525 | 0.2842 | 0.4602 | 0.4716 | 0.1764 | 0.4229 | 0.6576 | 0.5324 | 0.6784 | 0.2282 | 0.4582 | 0.2063 | 0.4027 | 0.1381 | 0.4123 | 0.2911 | 0.4062 | | 0.8718 | 80.0 | 8560 | 1.2793 | 0.2888 | 0.5613 | 0.2521 | 0.0779 | 0.2453 | 0.4497 | 0.2854 | 0.464 | 0.4748 | 0.1812 | 0.4356 | 0.6501 | 0.537 | 0.6734 | 0.2581 | 0.4861 | 0.2224 | 0.4125 | 0.1338 | 0.3985 | 0.2926 | 0.4036 | | 0.8574 | 81.0 | 8667 | 1.2768 | 0.2853 | 0.5614 | 0.2534 | 0.085 | 0.2389 | 0.4454 | 0.2847 | 0.4614 | 0.4718 | 0.1953 | 0.4209 | 0.6534 | 0.5334 | 0.6815 | 0.2342 | 0.4595 | 0.2176 | 0.4165 | 0.15 | 0.3985 | 0.2913 | 0.4031 | | 0.8564 | 82.0 | 8774 | 1.2782 | 0.2832 | 0.5646 | 0.2411 | 0.0917 | 0.2346 | 0.4385 | 0.284 | 0.4659 | 0.4774 | 0.2162 | 0.4213 | 0.6493 | 0.5293 | 0.6811 | 0.2323 | 0.4709 | 0.2203 | 0.4192 | 0.1401 | 0.4046 | 0.2941 | 0.4111 | | 0.8492 | 83.0 | 8881 | 1.2697 | 0.2816 | 0.5515 | 0.2545 | 0.0855 | 0.236 | 0.4398 | 0.2908 | 0.4688 | 0.479 | 0.2011 | 0.4241 | 0.6596 | 0.5252 | 0.6793 | 0.2385 | 0.4861 | 0.2054 | 0.4205 | 0.1463 | 0.4046 | 0.2925 | 0.4044 | | 0.8459 | 84.0 | 8988 | 1.2767 | 0.2863 | 0.5626 | 0.2473 | 0.0857 | 0.2386 | 0.4431 | 0.2897 | 0.4627 | 0.4723 | 0.1854 | 0.4164 | 0.6541 | 0.5434 | 0.6914 | 0.2267 | 0.4696 | 0.2308 | 0.4165 | 0.1434 | 0.3877 | 0.287 | 0.396 | | 0.8295 | 85.0 | 9095 | 1.2625 | 0.2864 | 0.5699 | 0.2489 | 0.084 | 0.2389 | 0.4477 | 0.2889 | 0.4599 | 0.47 | 0.1786 | 0.4187 | 0.6499 | 0.5455 | 0.6923 | 0.2287 | 0.462 | 0.2252 | 0.421 | 0.1397 | 0.3754 | 0.2929 | 0.3991 | | 0.8474 | 86.0 | 9202 | 1.2640 | 0.2925 | 0.572 | 0.2551 | 0.0931 | 0.2401 | 0.453 | 0.2922 | 0.4686 | 0.4778 | 0.1842 | 0.4289 | 0.6645 | 0.544 | 0.6914 | 0.2442 | 0.4886 | 0.2219 | 0.4071 | 0.1569 | 0.3969 | 0.2952 | 0.4049 | | 0.8288 | 87.0 | 9309 | 1.2591 | 0.2863 | 0.563 | 0.2478 | 0.0803 | 0.2381 | 0.4456 | 0.2857 | 0.4635 | 0.4744 | 0.1918 | 0.425 | 0.6502 | 0.5464 | 0.6959 | 0.2381 | 0.4899 | 0.216 | 0.408 | 0.1411 | 0.3769 | 0.2897 | 0.4013 | | 0.8408 | 88.0 | 9416 | 1.2432 | 0.2919 | 0.5713 | 0.2494 | 0.0926 | 0.2446 | 0.4512 | 0.2944 | 0.4682 | 0.4771 | 0.2127 | 0.4237 | 0.6558 | 0.5439 | 0.6869 | 0.2523 | 0.4823 | 0.2304 | 0.4138 | 0.1399 | 0.3938 | 0.2932 | 0.4084 | | 0.835 | 89.0 | 9523 | 1.2472 | 0.2885 | 0.5652 | 0.2456 | 0.0925 | 0.241 | 0.4443 | 0.2892 | 0.4662 | 0.4773 | 0.2096 | 0.4296 | 0.6479 | 0.5483 | 0.6986 | 0.2465 | 0.4709 | 0.2226 | 0.4152 | 0.1322 | 0.3908 | 0.2928 | 0.4111 | | 0.8299 | 90.0 | 9630 | 1.2481 | 0.2898 | 0.5648 | 0.2528 | 0.0972 | 0.239 | 0.4457 | 0.2939 | 0.463 | 0.4703 | 0.1948 | 0.4196 | 0.6457 | 0.5405 | 0.6829 | 0.2402 | 0.4646 | 0.2221 | 0.4022 | 0.1512 | 0.3892 | 0.295 | 0.4124 | | 0.817 | 91.0 | 9737 | 1.2366 | 0.2924 | 0.576 | 0.2475 | 0.0951 | 0.2384 | 0.4528 | 0.2952 | 0.4674 | 0.4775 | 0.2033 | 0.4255 | 0.6498 | 0.5415 | 0.6914 | 0.2416 | 0.4696 | 0.2272 | 0.4089 | 0.1537 | 0.3985 | 0.2981 | 0.4191 | | 0.8196 | 92.0 | 9844 | 1.2502 | 0.2943 | 0.5749 | 0.2597 | 0.089 | 0.2433 | 0.4536 | 0.2961 | 0.4633 | 0.4753 | 0.1969 | 0.423 | 0.6582 | 0.5436 | 0.6883 | 0.2408 | 0.4722 | 0.2311 | 0.4138 | 0.1565 | 0.3862 | 0.2993 | 0.416 | | 0.8184 | 93.0 | 9951 | 1.2399 | 0.2955 | 0.5787 | 0.2571 | 0.0902 | 0.2481 | 0.4588 | 0.294 | 0.4652 | 0.4756 | 0.2001 | 0.4218 | 0.6572 | 0.5405 | 0.6869 | 0.2498 | 0.4722 | 0.2357 | 0.4254 | 0.158 | 0.3815 | 0.2936 | 0.412 | | 0.8053 | 94.0 | 10058 | 1.2512 | 0.2964 | 0.5754 | 0.2633 | 0.0953 | 0.2468 | 0.4592 | 0.2955 | 0.4662 | 0.4786 | 0.1966 | 0.4229 | 0.6605 | 0.5436 | 0.6937 | 0.2502 | 0.4747 | 0.2288 | 0.4143 | 0.1627 | 0.3969 | 0.2964 | 0.4133 | | 0.8152 | 95.0 | 10165 | 1.2426 | 0.2965 | 0.5709 | 0.2562 | 0.0884 | 0.2481 | 0.4587 | 0.2989 | 0.4688 | 0.4784 | 0.19 | 0.4268 | 0.6613 | 0.5405 | 0.6883 | 0.2481 | 0.4722 | 0.2282 | 0.4134 | 0.1713 | 0.4046 | 0.2945 | 0.4133 | | 0.8115 | 96.0 | 10272 | 1.2396 | 0.2958 | 0.5727 | 0.2662 | 0.0912 | 0.2454 | 0.4651 | 0.3015 | 0.4677 | 0.4773 | 0.2023 | 0.421 | 0.6692 | 0.538 | 0.6838 | 0.2547 | 0.4671 | 0.228 | 0.4205 | 0.16 | 0.3954 | 0.2983 | 0.4196 | | 0.7983 | 97.0 | 10379 | 1.2417 | 0.2936 | 0.5731 | 0.2486 | 0.0893 | 0.2465 | 0.4624 | 0.2996 | 0.4718 | 0.4819 | 0.2028 | 0.4284 | 0.6697 | 0.5382 | 0.6892 | 0.2593 | 0.4772 | 0.2267 | 0.4223 | 0.1469 | 0.4031 | 0.2969 | 0.4178 | | 0.8217 | 98.0 | 10486 | 1.2373 | 0.2948 | 0.5722 | 0.257 | 0.0894 | 0.2455 | 0.4597 | 0.2974 | 0.4696 | 0.4801 | 0.2037 | 0.4225 | 0.6672 | 0.5365 | 0.6878 | 0.2612 | 0.481 | 0.2291 | 0.4237 | 0.1513 | 0.3892 | 0.2958 | 0.4187 | | 0.7961 | 99.0 | 10593 | 1.2396 | 0.296 | 0.5758 | 0.2587 | 0.0911 | 0.2463 | 0.4624 | 0.2971 | 0.4705 | 0.4808 | 0.2004 | 0.4241 | 0.6697 | 0.5372 | 0.6883 | 0.2632 | 0.4797 | 0.228 | 0.421 | 0.1539 | 0.3908 | 0.2977 | 0.4244 | | 0.8025 | 100.0 | 10700 | 1.2399 | 0.296 | 0.5758 | 0.258 | 0.0949 | 0.2452 | 0.4635 | 0.2979 | 0.4713 | 0.4813 | 0.2026 | 0.4228 | 0.6701 | 0.5371 | 0.6878 | 0.2634 | 0.4785 | 0.2261 | 0.4201 | 0.1544 | 0.3954 | 0.299 | 0.4249 | ### Framework versions - Transformers 4.46.0.dev0 - Pytorch 2.4.1+cu118 - Datasets 3.0.1 - Tokenizers 0.20.1