metadata
license: other
base_model: nvidia/mit-b0
tags:
- generated_from_keras_callback
model-index:
- name: luca-g97/mit-b0-finetuned-sidewalks
results: []
luca-g97/mit-b0-finetuned-sidewalks
This model is a fine-tuned version of nvidia/mit-b0 on an unknown dataset. It achieves the following results on the evaluation set:
- Train Loss: 0.1941
- Validation Loss: 0.5077
- Validation Mean Iou: 0.3541
- Validation Mean Accuracy: 0.4368
- Validation Overall Accuracy: 0.8760
- Validation Accuracy Unlabeled: 0.0
- Validation Accuracy Flat-road: 0.8810
- Validation Accuracy Flat-sidewalk: 0.9600
- Validation Accuracy Flat-crosswalk: 0.5080
- Validation Accuracy Flat-cyclinglane: 0.7956
- Validation Accuracy Flat-parkingdriveway: 0.4939
- Validation Accuracy Flat-railtrack: nan
- Validation Accuracy Flat-curb: 0.5978
- Validation Accuracy Human-person: 0.7554
- Validation Accuracy Human-rider: 0.1367
- Validation Accuracy Vehicle-car: 0.9179
- Validation Accuracy Vehicle-truck: 0.0599
- Validation Accuracy Vehicle-bus: nan
- Validation Accuracy Vehicle-tramtrain: nan
- Validation Accuracy Vehicle-motorcycle: 0.0
- Validation Accuracy Vehicle-bicycle: 0.7221
- Validation Accuracy Vehicle-caravan: 0.0
- Validation Accuracy Vehicle-cartrailer: 0.0
- Validation Accuracy Construction-building: 0.8944
- Validation Accuracy Construction-door: 0.1175
- Validation Accuracy Construction-wall: 0.6129
- Validation Accuracy Construction-fenceguardrail: 0.4032
- Validation Accuracy Construction-bridge: 0.0
- Validation Accuracy Construction-tunnel: nan
- Validation Accuracy Construction-stairs: 0.2636
- Validation Accuracy Object-pole: 0.4817
- Validation Accuracy Object-trafficsign: 0.3849
- Validation Accuracy Object-trafficlight: 0.0
- Validation Accuracy Nature-vegetation: 0.9453
- Validation Accuracy Nature-terrain: 0.9461
- Validation Accuracy Sky: 0.9760
- Validation Accuracy Void-ground: 0.0649
- Validation Accuracy Void-dynamic: 0.1096
- Validation Accuracy Void-static: 0.5128
- Validation Accuracy Void-unclear: 0.0
- Validation Iou Unlabeled: 0.0
- Validation Iou Flat-road: 0.7899
- Validation Iou Flat-sidewalk: 0.8798
- Validation Iou Flat-crosswalk: 0.3854
- Validation Iou Flat-cyclinglane: 0.7444
- Validation Iou Flat-parkingdriveway: 0.3950
- Validation Iou Flat-railtrack: nan
- Validation Iou Flat-curb: 0.5344
- Validation Iou Human-person: 0.4893
- Validation Iou Human-rider: 0.1164
- Validation Iou Vehicle-car: 0.7795
- Validation Iou Vehicle-truck: 0.0515
- Validation Iou Vehicle-bus: nan
- Validation Iou Vehicle-tramtrain: 0.0
- Validation Iou Vehicle-motorcycle: 0.0
- Validation Iou Vehicle-bicycle: 0.5232
- Validation Iou Vehicle-caravan: 0.0
- Validation Iou Vehicle-cartrailer: 0.0
- Validation Iou Construction-building: 0.7498
- Validation Iou Construction-door: 0.1094
- Validation Iou Construction-wall: 0.4920
- Validation Iou Construction-fenceguardrail: 0.3325
- Validation Iou Construction-bridge: 0.0
- Validation Iou Construction-tunnel: nan
- Validation Iou Construction-stairs: 0.2083
- Validation Iou Object-pole: 0.3678
- Validation Iou Object-trafficsign: 0.2519
- Validation Iou Object-trafficlight: 0.0
- Validation Iou Nature-vegetation: 0.8789
- Validation Iou Nature-terrain: 0.8304
- Validation Iou Sky: 0.9409
- Validation Iou Void-ground: 0.0447
- Validation Iou Void-dynamic: 0.0765
- Validation Iou Void-static: 0.3601
- Validation Iou Void-unclear: 0.0
- Epoch: 30
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': 6e-05, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
- training_precision: float32
Training results
Train Loss | Validation Loss | Validation Mean Iou | Validation Mean Accuracy | Validation Overall Accuracy | Validation Accuracy Unlabeled | Validation Accuracy Flat-road | Validation Accuracy Flat-sidewalk | Validation Accuracy Flat-crosswalk | Validation Accuracy Flat-cyclinglane | Validation Accuracy Flat-parkingdriveway | Validation Accuracy Flat-railtrack | Validation Accuracy Flat-curb | Validation Accuracy Human-person | Validation Accuracy Human-rider | Validation Accuracy Vehicle-car | Validation Accuracy Vehicle-truck | Validation Accuracy Vehicle-bus | Validation Accuracy Vehicle-tramtrain | Validation Accuracy Vehicle-motorcycle | Validation Accuracy Vehicle-bicycle | Validation Accuracy Vehicle-caravan | Validation Accuracy Vehicle-cartrailer | Validation Accuracy Construction-building | Validation Accuracy Construction-door | Validation Accuracy Construction-wall | Validation Accuracy Construction-fenceguardrail | Validation Accuracy Construction-bridge | Validation Accuracy Construction-tunnel | Validation Accuracy Construction-stairs | Validation Accuracy Object-pole | Validation Accuracy Object-trafficsign | Validation Accuracy Object-trafficlight | Validation Accuracy Nature-vegetation | Validation Accuracy Nature-terrain | Validation Accuracy Sky | Validation Accuracy Void-ground | Validation Accuracy Void-dynamic | Validation Accuracy Void-static | Validation Accuracy Void-unclear | Validation Iou Unlabeled | Validation Iou Flat-road | Validation Iou Flat-sidewalk | Validation Iou Flat-crosswalk | Validation Iou Flat-cyclinglane | Validation Iou Flat-parkingdriveway | Validation Iou Flat-railtrack | Validation Iou Flat-curb | Validation Iou Human-person | Validation Iou Human-rider | Validation Iou Vehicle-car | Validation Iou Vehicle-truck | Validation Iou Vehicle-bus | Validation Iou Vehicle-tramtrain | Validation Iou Vehicle-motorcycle | Validation Iou Vehicle-bicycle | Validation Iou Vehicle-caravan | Validation Iou Vehicle-cartrailer | Validation Iou Construction-building | Validation Iou Construction-door | Validation Iou Construction-wall | Validation Iou Construction-fenceguardrail | Validation Iou Construction-bridge | Validation Iou Construction-tunnel | Validation Iou Construction-stairs | Validation Iou Object-pole | Validation Iou Object-trafficsign | Validation Iou Object-trafficlight | Validation Iou Nature-vegetation | Validation Iou Nature-terrain | Validation Iou Sky | Validation Iou Void-ground | Validation Iou Void-dynamic | Validation Iou Void-static | Validation Iou Void-unclear | Epoch |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1.3678 | 0.8166 | 0.1980 | 0.2461 | 0.7806 | 0.0 | 0.7198 | 0.9333 | 0.1239 | 0.6224 | 0.2909 | nan | 0.2044 | 0.0227 | 0.0 | 0.8980 | 0.0 | nan | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.8838 | 0.0 | 0.0930 | 0.0426 | 0.0 | nan | 0.0 | 0.0725 | 0.0 | 0.0 | 0.9093 | 0.8657 | 0.9392 | 0.0 | 0.0 | 0.0062 | 0.0 | 0.0 | 0.5656 | 0.7927 | 0.1207 | 0.5722 | 0.1948 | nan | 0.1673 | 0.0225 | 0.0 | 0.5772 | 0.0 | nan | nan | 0.0 | 0.0 | 0.0 | 0.0 | 0.5809 | 0.0 | 0.0864 | 0.0425 | 0.0 | nan | 0.0 | 0.0692 | 0.0 | 0.0 | 0.7793 | 0.6938 | 0.8673 | 0.0 | 0.0 | 0.0061 | 0.0 | 0 |
0.8157 | 0.6782 | 0.2459 | 0.3022 | 0.8185 | 0.0 | 0.8366 | 0.9295 | 0.4668 | 0.7053 | 0.2766 | nan | 0.2969 | 0.5333 | 0.0 | 0.8409 | 0.0 | nan | nan | 0.0 | 0.0069 | 0.0 | 0.0 | 0.9093 | 0.0 | 0.3089 | 0.2250 | 0.0 | nan | 0.0 | 0.2037 | 0.0 | 0.0 | 0.9486 | 0.8869 | 0.9594 | 0.0 | 0.0 | 0.0323 | 0.0 | 0.0 | 0.6544 | 0.8362 | 0.3660 | 0.6237 | 0.2080 | nan | 0.2318 | 0.2292 | 0.0 | 0.6802 | 0.0 | nan | nan | 0.0 | 0.0069 | 0.0 | 0.0 | 0.6389 | 0.0 | 0.2751 | 0.2078 | 0.0 | nan | 0.0 | 0.1733 | 0.0 | 0.0 | 0.8125 | 0.7673 | 0.8818 | 0.0 | 0.0 | 0.0310 | 0.0 | 1 |
0.6971 | 0.6359 | 0.2706 | 0.3314 | 0.8186 | 0.0 | 0.8099 | 0.9316 | 0.4949 | 0.6689 | 0.2490 | nan | 0.3254 | 0.5711 | 0.0 | 0.8972 | 0.0 | nan | nan | 0.0 | 0.3873 | 0.0 | 0.0 | 0.9079 | 0.0 | 0.5179 | 0.3214 | 0.0 | nan | 0.0 | 0.3090 | 0.0 | 0.0 | 0.9340 | 0.8005 | 0.9599 | 0.0 | 0.0140 | 0.1744 | 0.0 | 0.0 | 0.6485 | 0.8294 | 0.2456 | 0.6194 | 0.1932 | nan | 0.2772 | 0.3387 | 0.0 | 0.6913 | 0.0 | nan | nan | 0.0 | 0.3516 | 0.0 | 0.0 | 0.6685 | 0.0 | 0.4051 | 0.2726 | 0.0 | nan | 0.0 | 0.2356 | 0.0 | 0.0 | 0.8189 | 0.7404 | 0.8881 | 0.0 | 0.0131 | 0.1515 | 0.0 | 2 |
0.6190 | 0.5661 | 0.2928 | 0.3492 | 0.8410 | 0.0 | 0.8018 | 0.9605 | 0.4340 | 0.7528 | 0.2925 | nan | 0.3419 | 0.6177 | 0.0 | 0.8887 | 0.0 | nan | nan | 0.0 | 0.5688 | 0.0 | 0.0 | 0.9146 | 0.0 | 0.5262 | 0.3174 | 0.0 | nan | 0.0 | 0.3713 | 0.0 | 0.0 | 0.9455 | 0.8983 | 0.9440 | 0.0 | 0.0473 | 0.2025 | 0.0 | 0.0 | 0.6959 | 0.8428 | 0.4016 | 0.6376 | 0.2351 | nan | 0.3048 | 0.3808 | 0.0 | 0.7238 | 0.0 | nan | nan | 0.0 | 0.4529 | 0.0 | 0.0 | 0.6973 | 0.0 | 0.4300 | 0.2747 | 0.0 | nan | 0.0 | 0.2645 | 0.0 | 0.0 | 0.8487 | 0.7814 | 0.9004 | 0.0 | 0.0317 | 0.1718 | 0.0 | 3 |
0.5546 | 0.5378 | 0.3005 | 0.3645 | 0.8455 | 0.0 | 0.8288 | 0.9414 | 0.4559 | 0.7588 | 0.4077 | nan | 0.4985 | 0.5859 | 0.0 | 0.9055 | 0.0 | nan | nan | 0.0 | 0.5452 | 0.0 | 0.0 | 0.9012 | 0.0 | 0.5211 | 0.3851 | 0.0 | nan | 0.0 | 0.3665 | 0.0 | 0.0 | 0.9333 | 0.9072 | 0.9626 | 0.0004 | 0.0532 | 0.3407 | 0.0 | 0.0 | 0.7155 | 0.8525 | 0.3475 | 0.6677 | 0.3046 | nan | 0.3939 | 0.3489 | 0.0 | 0.7226 | 0.0 | nan | nan | 0.0 | 0.4275 | 0.0 | 0.0 | 0.6930 | 0.0 | 0.4213 | 0.2958 | 0.0 | nan | 0.0 | 0.2748 | 0.0 | 0.0 | 0.8559 | 0.7770 | 0.9057 | 0.0003 | 0.0454 | 0.2655 | 0.0 | 4 |
0.5012 | 0.5478 | 0.3005 | 0.3737 | 0.8410 | 0.0 | 0.7172 | 0.9665 | 0.4663 | 0.8264 | 0.3314 | nan | 0.4364 | 0.7392 | 0.0 | 0.8793 | 0.0 | nan | nan | 0.0 | 0.6710 | 0.0 | 0.0 | 0.8810 | 0.0040 | 0.5212 | 0.4739 | 0.0 | nan | 0.0 | 0.4279 | 0.0 | 0.0 | 0.9229 | 0.9260 | 0.9578 | 0.0 | 0.1377 | 0.2975 | 0.0 | 0.0 | 0.6691 | 0.8400 | 0.3682 | 0.6677 | 0.2650 | nan | 0.3581 | 0.3654 | 0.0 | 0.7473 | 0.0 | nan | nan | 0.0 | 0.4533 | 0.0 | 0.0 | 0.7095 | 0.0040 | 0.3844 | 0.3315 | 0.0 | nan | 0.0 | 0.2911 | 0.0 | 0.0 | 0.8621 | 0.8017 | 0.9127 | 0.0 | 0.0533 | 0.2311 | 0.0 | 5 |
0.4696 | 0.5304 | 0.3069 | 0.3761 | 0.8494 | 0.0 | 0.8421 | 0.9436 | 0.4656 | 0.7385 | 0.4812 | nan | 0.5467 | 0.7282 | 0.0 | 0.9217 | 0.0 | nan | nan | 0.0 | 0.5838 | 0.0 | 0.0 | 0.8754 | 0.0164 | 0.5180 | 0.4119 | 0.0 | nan | 0.0 | 0.3841 | 0.0049 | 0.0 | 0.9503 | 0.8761 | 0.9670 | 0.0 | 0.1233 | 0.2799 | 0.0 | 0.0 | 0.7387 | 0.8537 | 0.3492 | 0.6961 | 0.3412 | nan | 0.4438 | 0.3894 | 0.0 | 0.7149 | 0.0 | nan | nan | 0.0 | 0.4264 | 0.0 | 0.0 | 0.7074 | 0.0163 | 0.3938 | 0.2934 | 0.0 | nan | 0.0 | 0.2882 | 0.0049 | 0.0 | 0.8522 | 0.7903 | 0.9116 | 0.0 | 0.0756 | 0.2273 | 0.0 | 6 |
0.4253 | 0.5283 | 0.3140 | 0.3804 | 0.8512 | 0.0 | 0.8989 | 0.9158 | 0.4850 | 0.7735 | 0.5623 | nan | 0.4545 | 0.6829 | 0.0 | 0.9019 | 0.0 | nan | nan | 0.0 | 0.5551 | 0.0 | 0.0 | 0.9127 | 0.0041 | 0.5504 | 0.3501 | 0.0 | nan | 0.1083 | 0.4291 | 0.0133 | 0.0 | 0.9489 | 0.9091 | 0.9659 | 0.0 | 0.0944 | 0.2753 | 0.0 | 0.0 | 0.7192 | 0.8621 | 0.4080 | 0.7179 | 0.3419 | nan | 0.3818 | 0.4004 | 0.0 | 0.7424 | 0.0 | nan | nan | 0.0 | 0.4431 | 0.0 | 0.0 | 0.7140 | 0.0040 | 0.4269 | 0.2753 | 0.0 | nan | 0.1041 | 0.3078 | 0.0132 | 0.0 | 0.8562 | 0.7841 | 0.9159 | 0.0 | 0.0738 | 0.2402 | 0.0 | 7 |
0.4050 | 0.5155 | 0.3203 | 0.3976 | 0.8550 | 0.0 | 0.8329 | 0.9366 | 0.4963 | 0.8614 | 0.4826 | nan | 0.5578 | 0.7241 | 0.0 | 0.8664 | 0.0 | nan | nan | 0.0 | 0.6993 | 0.0 | 0.0 | 0.8821 | 0.0810 | 0.5857 | 0.4431 | 0.0 | nan | 0.0655 | 0.4235 | 0.1598 | 0.0 | 0.9457 | 0.9156 | 0.9722 | 0.0 | 0.0985 | 0.2959 | 0.0 | 0.0 | 0.7187 | 0.8706 | 0.3583 | 0.7082 | 0.3354 | nan | 0.4595 | 0.3835 | 0.0 | 0.7495 | 0.0 | nan | nan | 0.0 | 0.4427 | 0.0 | 0.0 | 0.7288 | 0.0760 | 0.4159 | 0.3283 | 0.0 | nan | 0.0641 | 0.2988 | 0.1106 | 0.0 | 0.8617 | 0.8017 | 0.9180 | 0.0 | 0.0547 | 0.2441 | 0.0 | 8 |
0.3736 | 0.5247 | 0.3238 | 0.3898 | 0.8552 | 0.0 | 0.8784 | 0.9346 | 0.4956 | 0.7814 | 0.4293 | nan | 0.5294 | 0.7039 | 0.0 | 0.9317 | 0.0 | nan | nan | 0.0 | 0.5909 | 0.0 | 0.0 | 0.8907 | 0.0561 | 0.5289 | 0.3452 | 0.0 | nan | 0.1251 | 0.3892 | 0.1104 | 0.0 | 0.9318 | 0.9387 | 0.9699 | 0.0028 | 0.0957 | 0.4239 | 0.0 | 0.0 | 0.7247 | 0.8604 | 0.3760 | 0.7168 | 0.3123 | nan | 0.4448 | 0.4529 | 0.0 | 0.7461 | 0.0 | nan | nan | 0.0 | 0.4482 | 0.0 | 0.0 | 0.7247 | 0.0535 | 0.4300 | 0.2811 | 0.0 | nan | 0.1229 | 0.3080 | 0.0869 | 0.0 | 0.8635 | 0.8011 | 0.9229 | 0.0025 | 0.0510 | 0.3076 | 0.0 | 9 |
0.3660 | 0.5736 | 0.3205 | 0.3821 | 0.8480 | 0.0 | 0.7531 | 0.9718 | 0.4589 | 0.6779 | 0.3548 | nan | 0.5450 | 0.7285 | 0.0 | 0.9037 | 0.0 | nan | nan | 0.0 | 0.5942 | 0.0 | 0.0 | 0.9021 | 0.0158 | 0.5726 | 0.3303 | 0.0 | nan | 0.1523 | 0.4334 | 0.1331 | 0.0 | 0.9518 | 0.9186 | 0.9753 | 0.0083 | 0.1894 | 0.2739 | 0.0 | 0.0 | 0.6874 | 0.8352 | 0.3769 | 0.6518 | 0.2890 | nan | 0.4676 | 0.4524 | 0.0 | 0.7543 | 0.0 | nan | nan | 0.0 | 0.4748 | 0.0 | 0.0 | 0.7261 | 0.0153 | 0.4510 | 0.2708 | 0.0 | nan | 0.1462 | 0.3191 | 0.1197 | 0.0 | 0.8651 | 0.7985 | 0.9259 | 0.0079 | 0.0753 | 0.2257 | 0.0 | 10 |
0.3392 | 0.4919 | 0.3375 | 0.4135 | 0.8621 | 0.0 | 0.8390 | 0.9461 | 0.4833 | 0.8450 | 0.5165 | nan | 0.5727 | 0.7460 | 0.0002 | 0.8947 | 0.0003 | nan | nan | 0.0 | 0.7287 | 0.0 | 0.0 | 0.9005 | 0.0569 | 0.5783 | 0.4042 | 0.0 | nan | 0.1868 | 0.4545 | 0.1994 | 0.0 | 0.9291 | 0.9408 | 0.9775 | 0.1256 | 0.1342 | 0.3576 | 0.0 | 0.0 | 0.7353 | 0.8747 | 0.3814 | 0.7270 | 0.3691 | nan | 0.4786 | 0.4109 | 0.0002 | 0.7686 | 0.0003 | nan | nan | 0.0 | 0.4835 | 0.0 | 0.0 | 0.7306 | 0.0527 | 0.4655 | 0.2977 | 0.0 | nan | 0.1652 | 0.3295 | 0.1699 | 0.0 | 0.8718 | 0.8125 | 0.9248 | 0.0877 | 0.0535 | 0.2729 | 0.0 | 11 |
0.3274 | 0.5153 | 0.3302 | 0.4071 | 0.8585 | 0.0 | 0.9093 | 0.9274 | 0.4820 | 0.8091 | 0.4834 | nan | 0.4533 | 0.7872 | 0.0107 | 0.9117 | 0.0001 | nan | nan | 0.0 | 0.6741 | 0.0 | 0.0 | 0.8985 | 0.0589 | 0.5968 | 0.4355 | 0.0 | nan | 0.1966 | 0.4348 | 0.2332 | 0.0 | 0.9394 | 0.9349 | 0.9712 | 0.0237 | 0.1825 | 0.2670 | 0.0 | 0.0 | 0.7495 | 0.8631 | 0.3891 | 0.7515 | 0.3469 | nan | 0.4007 | 0.3865 | 0.0095 | 0.7635 | 0.0001 | nan | nan | 0.0 | 0.4943 | 0.0 | 0.0 | 0.7370 | 0.0576 | 0.4389 | 0.3287 | 0.0 | nan | 0.1678 | 0.3169 | 0.1431 | 0.0 | 0.8631 | 0.7915 | 0.9288 | 0.0172 | 0.0675 | 0.2234 | 0.0 | 12 |
0.3221 | 0.5148 | 0.3329 | 0.4010 | 0.8608 | 0.0 | 0.8625 | 0.9491 | 0.3924 | 0.8131 | 0.4245 | nan | 0.5415 | 0.7432 | 0.0113 | 0.9079 | 0.0002 | nan | nan | 0.0 | 0.6333 | 0.0 | 0.0 | 0.9290 | 0.0873 | 0.5861 | 0.4376 | 0.0 | nan | 0.1606 | 0.4185 | 0.2101 | 0.0 | 0.9395 | 0.8990 | 0.9714 | 0.0654 | 0.1436 | 0.3051 | 0.0 | 0.0 | 0.7564 | 0.8669 | 0.3249 | 0.7026 | 0.3299 | nan | 0.4655 | 0.4331 | 0.0099 | 0.7630 | 0.0002 | nan | nan | 0.0 | 0.4753 | 0.0 | 0.0 | 0.7191 | 0.0809 | 0.4667 | 0.3315 | 0.0 | nan | 0.1472 | 0.3229 | 0.1520 | 0.0 | 0.8683 | 0.8078 | 0.9306 | 0.0497 | 0.0651 | 0.2508 | 0.0 | 13 |
0.3056 | 0.5403 | 0.3368 | 0.4091 | 0.8557 | 0.0 | 0.8120 | 0.9533 | 0.4851 | 0.7418 | 0.3948 | nan | 0.6013 | 0.7937 | 0.0060 | 0.9137 | 0.0023 | nan | nan | 0.0 | 0.6186 | 0.0 | 0.0 | 0.8791 | 0.0825 | 0.6385 | 0.3862 | 0.0 | nan | 0.2158 | 0.3970 | 0.2625 | 0.0 | 0.9463 | 0.9225 | 0.9755 | 0.0393 | 0.1919 | 0.4232 | 0.0 | 0.0 | 0.7225 | 0.8512 | 0.3795 | 0.6770 | 0.2905 | nan | 0.5000 | 0.4606 | 0.0052 | 0.7784 | 0.0021 | nan | nan | 0.0 | 0.4949 | 0.0 | 0.0 | 0.7344 | 0.0757 | 0.4592 | 0.3062 | 0.0 | nan | 0.1658 | 0.3130 | 0.1830 | 0.0 | 0.8707 | 0.8090 | 0.9284 | 0.0368 | 0.0813 | 0.3143 | 0.0 | 14 |
0.2898 | 0.4892 | 0.3480 | 0.4206 | 0.8694 | 0.0 | 0.8454 | 0.9589 | 0.4744 | 0.8461 | 0.4562 | nan | 0.5836 | 0.7364 | 0.1053 | 0.9102 | 0.0031 | nan | nan | 0.0 | 0.7415 | 0.0 | 0.0 | 0.9016 | 0.0974 | 0.6077 | 0.4400 | 0.0 | nan | 0.2158 | 0.4142 | 0.2735 | 0.0 | 0.9474 | 0.9256 | 0.9753 | 0.0861 | 0.1183 | 0.3736 | 0.0 | 0.0 | 0.7670 | 0.8740 | 0.3932 | 0.7655 | 0.3413 | nan | 0.5069 | 0.4278 | 0.0736 | 0.7823 | 0.0028 | nan | nan | 0.0 | 0.5135 | 0.0 | 0.0 | 0.7385 | 0.0884 | 0.4712 | 0.3544 | 0.0 | nan | 0.1490 | 0.3234 | 0.1806 | 0.0 | 0.8745 | 0.8187 | 0.9333 | 0.0641 | 0.0599 | 0.2825 | 0.0 | 15 |
0.2757 | 0.5107 | 0.3440 | 0.4124 | 0.8669 | 0.0 | 0.8181 | 0.9672 | 0.4493 | 0.8219 | 0.5424 | nan | 0.5567 | 0.7384 | 0.0114 | 0.9238 | 0.0039 | nan | nan | 0.0 | 0.6754 | 0.0 | 0.0 | 0.8965 | 0.0565 | 0.6267 | 0.3753 | 0.0 | nan | 0.2636 | 0.4058 | 0.2556 | 0.0 | 0.9293 | 0.9475 | 0.9743 | 0.0256 | 0.1501 | 0.3691 | 0.0 | 0.0 | 0.7619 | 0.8663 | 0.3868 | 0.7556 | 0.4069 | nan | 0.4870 | 0.4423 | 0.0104 | 0.7641 | 0.0036 | nan | nan | 0.0 | 0.4962 | 0.0 | 0.0 | 0.7423 | 0.0527 | 0.4982 | 0.3127 | 0.0 | nan | 0.1913 | 0.3226 | 0.1862 | 0.0 | 0.8639 | 0.7947 | 0.9350 | 0.0189 | 0.0757 | 0.2877 | 0.0 | 16 |
0.2541 | 0.5001 | 0.3465 | 0.4193 | 0.8675 | 0.0 | 0.8292 | 0.9581 | 0.4912 | 0.8537 | 0.4359 | nan | 0.6247 | 0.7447 | 0.0201 | 0.9260 | 0.0041 | nan | nan | 0.0 | 0.7137 | 0.0 | 0.0 | 0.9015 | 0.1173 | 0.5703 | 0.3468 | 0.0 | nan | 0.2524 | 0.4547 | 0.3021 | 0.0 | 0.9471 | 0.9186 | 0.9755 | 0.0396 | 0.1592 | 0.4123 | 0.0 | 0.0 | 0.7461 | 0.8762 | 0.4013 | 0.7225 | 0.3544 | nan | 0.5335 | 0.4415 | 0.0177 | 0.7683 | 0.0036 | nan | nan | 0.0 | 0.5075 | 0.0 | 0.0 | 0.7306 | 0.1099 | 0.4737 | 0.2855 | 0.0 | nan | 0.1933 | 0.3426 | 0.1773 | 0.0 | 0.8734 | 0.8156 | 0.9330 | 0.0257 | 0.0870 | 0.3216 | 0.0 | 17 |
0.2666 | 0.5042 | 0.3362 | 0.4197 | 0.8673 | 0.0 | 0.8441 | 0.9558 | 0.4772 | 0.8006 | 0.5152 | nan | 0.5665 | 0.7760 | 0.0768 | 0.9112 | 0.0066 | nan | nan | 0.0 | 0.7037 | 0.0 | 0.0 | 0.9012 | 0.1006 | 0.5956 | 0.3980 | 0.0 | nan | 0.2635 | 0.4163 | 0.3349 | 0.0 | 0.9520 | 0.9046 | 0.9791 | 0.0175 | 0.0496 | 0.4629 | 0.0 | 0.0 | 0.7501 | 0.8680 | 0.4113 | 0.7448 | 0.3768 | nan | 0.4808 | 0.4313 | 0.0608 | 0.7736 | 0.0057 | nan | 0.0 | 0.0 | 0.4943 | 0.0 | 0.0 | 0.7462 | 0.0930 | 0.4800 | 0.3276 | 0.0 | nan | 0.1969 | 0.3318 | 0.1824 | 0.0 | 0.8704 | 0.8125 | 0.9333 | 0.0156 | 0.0276 | 0.3427 | 0.0 | 18 |
0.2504 | 0.5142 | 0.3484 | 0.4145 | 0.8714 | 0.0 | 0.8371 | 0.9674 | 0.4828 | 0.8387 | 0.4438 | nan | 0.5916 | 0.7755 | 0.0336 | 0.9098 | 0.0039 | nan | nan | 0.0 | 0.6774 | 0.0 | 0.0 | 0.9074 | 0.0566 | 0.5599 | 0.3571 | 0.0 | nan | 0.2387 | 0.4355 | 0.3049 | 0.0 | 0.9527 | 0.9165 | 0.9758 | 0.0307 | 0.0807 | 0.4703 | 0.0 | 0.0 | 0.7646 | 0.8758 | 0.3941 | 0.7705 | 0.3512 | nan | 0.5130 | 0.4629 | 0.0282 | 0.7806 | 0.0034 | nan | nan | 0.0 | 0.4953 | 0.0 | 0.0 | 0.7313 | 0.0516 | 0.4698 | 0.3050 | 0.0 | nan | 0.2161 | 0.3409 | 0.1980 | 0.0 | 0.8760 | 0.8268 | 0.9366 | 0.0301 | 0.0500 | 0.3304 | 0.0 | 19 |
0.2446 | 0.5012 | 0.3515 | 0.4310 | 0.8716 | 0.0 | 0.8682 | 0.9618 | 0.4818 | 0.8386 | 0.4450 | nan | 0.5955 | 0.7539 | 0.1974 | 0.9232 | 0.0137 | nan | nan | 0.0 | 0.7583 | 0.0 | 0.0 | 0.8665 | 0.1288 | 0.6248 | 0.4094 | 0.0 | nan | 0.2788 | 0.4905 | 0.3509 | 0.0 | 0.9560 | 0.9269 | 0.9759 | 0.0396 | 0.1531 | 0.3212 | 0.0 | 0.0 | 0.7786 | 0.8820 | 0.3864 | 0.7625 | 0.3652 | nan | 0.5215 | 0.4361 | 0.1553 | 0.7780 | 0.0117 | nan | nan | 0.0 | 0.4862 | 0.0 | 0.0 | 0.7397 | 0.1005 | 0.4586 | 0.3304 | 0.0 | nan | 0.1980 | 0.3378 | 0.1937 | 0.0 | 0.8717 | 0.8109 | 0.9336 | 0.0279 | 0.0613 | 0.2703 | 0.0 | 20 |
0.2401 | 0.5020 | 0.3561 | 0.4308 | 0.8742 | 0.0 | 0.8655 | 0.9671 | 0.4700 | 0.8084 | 0.4765 | nan | 0.5854 | 0.7695 | 0.0770 | 0.9220 | 0.0103 | nan | nan | 0.0 | 0.7302 | 0.0 | 0.0 | 0.8743 | 0.1083 | 0.5923 | 0.4110 | 0.0 | nan | 0.2553 | 0.4874 | 0.3354 | 0.0 | 0.9538 | 0.9210 | 0.9794 | 0.1405 | 0.1450 | 0.4701 | 0.0 | 0.0 | 0.7971 | 0.8779 | 0.3889 | 0.7588 | 0.3682 | nan | 0.5158 | 0.4258 | 0.0633 | 0.7827 | 0.0091 | nan | nan | 0.0 | 0.5107 | 0.0 | 0.0 | 0.7496 | 0.0973 | 0.4638 | 0.3244 | 0.0 | nan | 0.2133 | 0.3548 | 0.1934 | 0.0 | 0.8749 | 0.8293 | 0.9331 | 0.0958 | 0.0682 | 0.3432 | 0.0 | 21 |
0.2212 | 0.5226 | 0.3627 | 0.4378 | 0.8700 | 0.0 | 0.8764 | 0.9647 | 0.5017 | 0.8379 | 0.4184 | nan | 0.6272 | 0.7174 | 0.2529 | 0.9041 | 0.0126 | nan | nan | 0.0 | 0.7586 | 0.0 | 0.0 | 0.9111 | 0.1342 | 0.6539 | 0.4660 | 0.0 | nan | 0.2615 | 0.4794 | 0.3201 | 0.0 | 0.8864 | 0.9573 | 0.9727 | 0.0723 | 0.2059 | 0.3793 | 0.0 | 0.0 | 0.7934 | 0.8781 | 0.3875 | 0.7868 | 0.3618 | nan | 0.5415 | 0.5344 | 0.1933 | 0.7899 | 0.0118 | nan | nan | 0.0 | 0.5426 | 0.0 | 0.0 | 0.7345 | 0.1159 | 0.4963 | 0.3845 | 0.0 | nan | 0.1821 | 0.3590 | 0.1928 | 0.0 | 0.8441 | 0.7387 | 0.9392 | 0.0546 | 0.0734 | 0.3064 | 0.0 | 22 |
0.2286 | 0.5119 | 0.3485 | 0.4300 | 0.8739 | 0.0 | 0.9060 | 0.9429 | 0.4847 | 0.8465 | 0.4336 | nan | 0.6466 | 0.7115 | 0.1329 | 0.9134 | 0.0078 | nan | nan | 0.0 | 0.7153 | 0.0 | 0.0 | 0.9073 | 0.0941 | 0.5938 | 0.4739 | 0.0 | nan | 0.2267 | 0.4684 | 0.3284 | 0.0 | 0.9536 | 0.9211 | 0.9768 | 0.0472 | 0.1654 | 0.4325 | 0.0 | 0.0 | 0.7818 | 0.8776 | 0.3993 | 0.7343 | 0.3657 | nan | 0.5462 | 0.5018 | 0.1147 | 0.7900 | 0.0070 | nan | 0.0 | 0.0 | 0.5133 | 0.0 | 0.0 | 0.7477 | 0.0884 | 0.4861 | 0.3631 | 0.0 | nan | 0.1971 | 0.3552 | 0.2041 | 0.0 | 0.8765 | 0.8029 | 0.9379 | 0.0403 | 0.0721 | 0.3499 | 0.0 | 23 |
0.2149 | 0.5215 | 0.3580 | 0.4310 | 0.8725 | 0.0 | 0.8805 | 0.9605 | 0.5094 | 0.8149 | 0.4046 | nan | 0.6248 | 0.7485 | 0.1781 | 0.9305 | 0.0324 | nan | nan | 0.0 | 0.7282 | 0.0 | 0.0 | 0.9008 | 0.1662 | 0.6190 | 0.3780 | 0.0 | nan | 0.2934 | 0.4534 | 0.3489 | 0.0 | 0.9547 | 0.8847 | 0.9790 | 0.0458 | 0.1169 | 0.4090 | 0.0 | 0.0 | 0.8043 | 0.8722 | 0.3930 | 0.7158 | 0.3413 | nan | 0.5459 | 0.4605 | 0.1261 | 0.7763 | 0.0277 | nan | nan | 0.0 | 0.4976 | 0.0 | 0.0 | 0.7451 | 0.1357 | 0.4977 | 0.3036 | 0.0 | nan | 0.2234 | 0.3532 | 0.2191 | 0.0 | 0.8704 | 0.8183 | 0.9363 | 0.0401 | 0.0650 | 0.3282 | 0.0 | 24 |
0.2116 | 0.5343 | 0.3555 | 0.4263 | 0.8695 | 0.0 | 0.8585 | 0.9634 | 0.5020 | 0.7841 | 0.5146 | nan | 0.5819 | 0.7780 | 0.1352 | 0.9088 | 0.0226 | nan | nan | 0.0 | 0.7205 | 0.0 | 0.0 | 0.9146 | 0.0458 | 0.6097 | 0.3694 | 0.0 | nan | 0.2702 | 0.4659 | 0.3618 | 0.0 | 0.9632 | 0.8248 | 0.9759 | 0.0555 | 0.1575 | 0.4305 | 0.0 | 0.0 | 0.7861 | 0.8710 | 0.4033 | 0.7300 | 0.3961 | nan | 0.5124 | 0.4329 | 0.1058 | 0.7851 | 0.0195 | nan | nan | 0.0 | 0.5317 | 0.0 | 0.0 | 0.7423 | 0.0426 | 0.5096 | 0.3190 | 0.0 | nan | 0.2290 | 0.3618 | 0.2138 | 0.0 | 0.8519 | 0.7803 | 0.9394 | 0.0424 | 0.0775 | 0.3381 | 0.0 | 25 |
0.2311 | 0.4961 | 0.3478 | 0.4364 | 0.8738 | 0.0 | 0.8734 | 0.9679 | 0.5055 | 0.7900 | 0.4253 | nan | 0.6437 | 0.7229 | 0.1989 | 0.8863 | 0.0392 | nan | nan | 0.0011 | 0.6654 | 0.0 | 0.0 | 0.8941 | 0.1576 | 0.6591 | 0.4683 | 0.0 | nan | 0.2810 | 0.4781 | 0.3731 | 0.0 | 0.9497 | 0.9264 | 0.9771 | 0.0650 | 0.2566 | 0.3215 | 0.0 | 0.0 | 0.7982 | 0.8820 | 0.4066 | 0.7279 | 0.3452 | nan | 0.5455 | 0.4411 | 0.1509 | 0.7748 | 0.0314 | nan | 0.0 | 0.0011 | 0.5164 | 0.0 | 0.0 | 0.7315 | 0.1440 | 0.4729 | 0.3721 | 0.0 | nan | 0.1511 | 0.3584 | 0.2174 | 0.0 | 0.8773 | 0.8355 | 0.9361 | 0.0497 | 0.0978 | 0.2643 | 0.0 | 26 |
0.2208 | 0.5502 | 0.3493 | 0.4366 | 0.8689 | 0.0 | 0.8383 | 0.9673 | 0.5042 | 0.7920 | 0.3196 | nan | 0.6306 | 0.7779 | 0.1291 | 0.9021 | 0.1445 | nan | nan | 0.0273 | 0.7410 | 0.0 | 0.0 | 0.8969 | 0.1208 | 0.5939 | 0.4402 | 0.0 | nan | 0.2468 | 0.4770 | 0.3748 | 0.0 | 0.9438 | 0.9466 | 0.9747 | 0.1148 | 0.1817 | 0.4475 | 0.0 | 0.0 | 0.7682 | 0.8633 | 0.4140 | 0.7395 | 0.2747 | nan | 0.5426 | 0.4367 | 0.1124 | 0.7849 | 0.1196 | nan | 0.0 | 0.0272 | 0.5120 | 0.0 | 0.0 | 0.7431 | 0.1154 | 0.4755 | 0.3410 | 0.0 | nan | 0.1788 | 0.3618 | 0.2128 | 0.0 | 0.8779 | 0.8179 | 0.9403 | 0.0889 | 0.0963 | 0.3342 | 0.0 | 27 |
0.2110 | 0.5231 | 0.3414 | 0.4290 | 0.8722 | 0.0 | 0.8684 | 0.9551 | 0.5060 | 0.8743 | 0.3936 | nan | 0.6295 | 0.7991 | 0.1233 | 0.9409 | 0.0481 | nan | nan | 0.0 | 0.7064 | 0.0 | 0.0 | 0.9129 | 0.1463 | 0.4067 | 0.4126 | 0.0 | nan | 0.2611 | 0.4535 | 0.3979 | 0.0 | 0.9440 | 0.9430 | 0.9801 | 0.1153 | 0.0838 | 0.3970 | 0.0 | 0.0 | 0.7971 | 0.8795 | 0.3698 | 0.7345 | 0.3286 | nan | 0.5408 | 0.4354 | 0.1101 | 0.7568 | 0.0463 | nan | 0.0 | 0.0 | 0.4965 | 0.0 | 0.0 | 0.7422 | 0.1314 | 0.3671 | 0.3160 | 0.0 | nan | 0.1858 | 0.3615 | 0.2297 | 0.0 | 0.8787 | 0.8337 | 0.9380 | 0.0751 | 0.0511 | 0.3184 | 0.0 | 28 |
0.1959 | 0.5240 | 0.3521 | 0.4343 | 0.8771 | 0.0 | 0.8744 | 0.9749 | 0.4993 | 0.8143 | 0.3366 | nan | 0.6376 | 0.7596 | 0.1736 | 0.9184 | 0.0424 | nan | nan | 0.0002 | 0.7469 | 0.0 | 0.0 | 0.8957 | 0.1516 | 0.5852 | 0.4130 | 0.0 | nan | 0.2630 | 0.4594 | 0.3941 | 0.0 | 0.9456 | 0.9363 | 0.9789 | 0.1007 | 0.1004 | 0.4621 | 0.0 | 0.0 | 0.8044 | 0.8775 | 0.4029 | 0.7728 | 0.2994 | nan | 0.5577 | 0.4748 | 0.1513 | 0.7884 | 0.0378 | nan | 0.0 | 0.0002 | 0.5007 | 0.0 | 0.0 | 0.7343 | 0.1427 | 0.4677 | 0.3440 | 0.0 | nan | 0.1765 | 0.3631 | 0.2372 | 0.0 | 0.8800 | 0.8324 | 0.9400 | 0.0701 | 0.0558 | 0.3558 | 0.0 | 29 |
0.1941 | 0.5077 | 0.3541 | 0.4368 | 0.8760 | 0.0 | 0.8810 | 0.9600 | 0.5080 | 0.7956 | 0.4939 | nan | 0.5978 | 0.7554 | 0.1367 | 0.9179 | 0.0599 | nan | nan | 0.0 | 0.7221 | 0.0 | 0.0 | 0.8944 | 0.1175 | 0.6129 | 0.4032 | 0.0 | nan | 0.2636 | 0.4817 | 0.3849 | 0.0 | 0.9453 | 0.9461 | 0.9760 | 0.0649 | 0.1096 | 0.5128 | 0.0 | 0.0 | 0.7899 | 0.8798 | 0.3854 | 0.7444 | 0.3950 | nan | 0.5344 | 0.4893 | 0.1164 | 0.7795 | 0.0515 | nan | 0.0 | 0.0 | 0.5232 | 0.0 | 0.0 | 0.7498 | 0.1094 | 0.4920 | 0.3325 | 0.0 | nan | 0.2083 | 0.3678 | 0.2519 | 0.0 | 0.8789 | 0.8304 | 0.9409 | 0.0447 | 0.0765 | 0.3601 | 0.0 | 30 |
Framework versions
- Transformers 4.35.0
- TensorFlow 2.14.0
- Datasets 2.14.6
- Tokenizers 0.14.1