File size: 39,041 Bytes
84e69c7 3d16e9f 84e69c7 3d16e9f 84e69c7 3d16e9f 84e69c7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 |
---
license: apache-2.0
base_model: albert-base-v2
tags:
- generated_from_trainer
metrics:
- precision
- recall
- f1
- accuracy
model-index:
- name: albert-base-v2-finetuned-ner-cadec
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# albert-base-v2-finetuned-ner-cadec
This model is a fine-tuned version of [albert-base-v2](https://huggingface.co/albert-base-v2) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.6830
- Precision: 0.6428
- Recall: 0.6704
- F1: 0.6563
- Accuracy: 0.9147
- Adr Precision: 0.6180
- Adr Recall: 0.6767
- Adr F1: 0.6460
- Disease Precision: 0.2581
- Disease Recall: 0.32
- Disease F1: 0.2857
- Drug Precision: 0.9036
- Drug Recall: 0.9259
- Drug F1: 0.9146
- Finding Precision: 0.4054
- Finding Recall: 0.2174
- Finding F1: 0.2830
- Symptom Precision: 0.4333
- Symptom Recall: 0.4815
- Symptom F1: 0.4561
- B-adr Precision: 0.7509
- B-adr Recall: 0.7735
- B-adr F1: 0.7620
- B-disease Precision: 0.2667
- B-disease Recall: 0.32
- B-disease F1: 0.2909
- B-drug Precision: 0.9563
- B-drug Recall: 0.9444
- B-drug F1: 0.9503
- B-finding Precision: 0.5312
- B-finding Recall: 0.2576
- B-finding F1: 0.3469
- B-symptom Precision: 0.5
- B-symptom Recall: 0.5185
- B-symptom F1: 0.5091
- I-adr Precision: 0.5959
- I-adr Recall: 0.6578
- I-adr F1: 0.6254
- I-disease Precision: 0.2174
- I-disease Recall: 0.2381
- I-disease F1: 0.2273
- I-drug Precision: 0.9096
- I-drug Recall: 0.9379
- I-drug F1: 0.9235
- I-finding Precision: 0.4
- I-finding Recall: 0.1923
- I-finding F1: 0.2597
- I-symptom Precision: 0.375
- I-symptom Recall: 0.4286
- I-symptom F1: 0.4000
- Macro Avg F1: 0.5295
- Weighted Avg F1: 0.6995
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 40
### Training results
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy | Adr Precision | Adr Recall | Adr F1 | Disease Precision | Disease Recall | Disease F1 | Drug Precision | Drug Recall | Drug F1 | Finding Precision | Finding Recall | Finding F1 | Symptom Precision | Symptom Recall | Symptom F1 | B-adr Precision | B-adr Recall | B-adr F1 | B-disease Precision | B-disease Recall | B-disease F1 | B-drug Precision | B-drug Recall | B-drug F1 | B-finding Precision | B-finding Recall | B-finding F1 | B-symptom Precision | B-symptom Recall | B-symptom F1 | I-adr Precision | I-adr Recall | I-adr F1 | I-disease Precision | I-disease Recall | I-disease F1 | I-drug Precision | I-drug Recall | I-drug F1 | I-finding Precision | I-finding Recall | I-finding F1 | I-symptom Precision | I-symptom Recall | I-symptom F1 | Macro Avg F1 | Weighted Avg F1 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|:-------------:|:----------:|:------:|:-----------------:|:--------------:|:----------:|:--------------:|:-----------:|:-------:|:-----------------:|:--------------:|:----------:|:-----------------:|:--------------:|:----------:|:---------------:|:------------:|:--------:|:-------------------:|:----------------:|:------------:|:----------------:|:-------------:|:---------:|:-------------------:|:----------------:|:------------:|:-------------------:|:----------------:|:------------:|:---------------:|:------------:|:--------:|:-------------------:|:----------------:|:------------:|:----------------:|:-------------:|:---------:|:-------------------:|:----------------:|:------------:|:-------------------:|:----------------:|:------------:|:------------:|:---------------:|
| No log | 1.0 | 125 | 0.3036 | 0.4900 | 0.5855 | 0.5335 | 0.8983 | 0.4564 | 0.6017 | 0.5191 | 0.0877 | 0.2 | 0.1220 | 0.8671 | 0.9259 | 0.8955 | 0.0294 | 0.0145 | 0.0194 | 0.0 | 0.0 | 0.0 | 0.6901 | 0.7805 | 0.7326 | 0.2 | 0.2 | 0.2000 | 0.9112 | 0.9506 | 0.9305 | 0.5 | 0.0152 | 0.0294 | 0.0 | 0.0 | 0.0 | 0.4781 | 0.5784 | 0.5235 | 0.0652 | 0.1429 | 0.0896 | 0.8830 | 0.9379 | 0.9096 | 0.1818 | 0.1154 | 0.1412 | 0.0 | 0.0 | 0.0 | 0.3556 | 0.6214 |
| No log | 2.0 | 250 | 0.2758 | 0.5594 | 0.6297 | 0.5924 | 0.9070 | 0.5310 | 0.6717 | 0.5931 | 0.1081 | 0.16 | 0.1290 | 0.8421 | 0.8889 | 0.8649 | 0.16 | 0.0580 | 0.0851 | 0.5 | 0.0370 | 0.0690 | 0.7317 | 0.7965 | 0.7627 | 0.2308 | 0.24 | 0.2353 | 0.9804 | 0.9259 | 0.9524 | 0.5385 | 0.1061 | 0.1772 | 1.0 | 0.0741 | 0.1379 | 0.5274 | 0.6660 | 0.5887 | 0.0952 | 0.0952 | 0.0952 | 0.8471 | 0.8944 | 0.8701 | 0.3125 | 0.0962 | 0.1471 | 0.0 | 0.0 | 0.0 | 0.3967 | 0.6599 |
| No log | 3.0 | 375 | 0.2840 | 0.5713 | 0.6489 | 0.6076 | 0.9079 | 0.5533 | 0.675 | 0.6081 | 0.1667 | 0.32 | 0.2192 | 0.8571 | 0.9259 | 0.8902 | 0.1842 | 0.1014 | 0.1308 | 0.3 | 0.1111 | 0.1622 | 0.7298 | 0.7982 | 0.7625 | 0.2162 | 0.32 | 0.2581 | 0.9281 | 0.9568 | 0.9422 | 0.4583 | 0.1667 | 0.2444 | 0.7 | 0.2593 | 0.3784 | 0.5482 | 0.6599 | 0.5989 | 0.1842 | 0.3333 | 0.2373 | 0.8671 | 0.9317 | 0.8982 | 0.2609 | 0.1154 | 0.16 | 0.0 | 0.0 | 0.0 | 0.4480 | 0.6744 |
| 0.2544 | 4.0 | 500 | 0.2906 | 0.5760 | 0.6353 | 0.6042 | 0.9104 | 0.5679 | 0.6483 | 0.6054 | 0.0816 | 0.16 | 0.1081 | 0.8862 | 0.9136 | 0.8997 | 0.2364 | 0.1884 | 0.2097 | 0.3889 | 0.2593 | 0.3111 | 0.7626 | 0.7788 | 0.7706 | 0.1875 | 0.24 | 0.2105 | 0.9379 | 0.9321 | 0.9350 | 0.4474 | 0.2576 | 0.3269 | 0.7333 | 0.4074 | 0.5238 | 0.5647 | 0.6314 | 0.5962 | 0.1579 | 0.2857 | 0.2034 | 0.8916 | 0.9193 | 0.9052 | 0.3143 | 0.2115 | 0.2529 | 0.6667 | 0.1429 | 0.2353 | 0.4960 | 0.6862 |
| 0.2544 | 5.0 | 625 | 0.2948 | 0.5855 | 0.6750 | 0.6270 | 0.9132 | 0.5633 | 0.6967 | 0.6230 | 0.0333 | 0.04 | 0.0364 | 0.8786 | 0.9383 | 0.9075 | 0.2549 | 0.1884 | 0.2167 | 0.5455 | 0.4444 | 0.4898 | 0.7312 | 0.8088 | 0.7681 | 0.2083 | 0.2 | 0.2041 | 0.9118 | 0.9568 | 0.9337 | 0.5161 | 0.2424 | 0.3299 | 0.7778 | 0.5185 | 0.6222 | 0.5507 | 0.6741 | 0.6062 | 0.0667 | 0.0476 | 0.0556 | 0.8994 | 0.9441 | 0.9212 | 0.3077 | 0.2308 | 0.2637 | 0.625 | 0.3571 | 0.4545 | 0.5159 | 0.6920 |
| 0.2544 | 6.0 | 750 | 0.3172 | 0.6092 | 0.6569 | 0.6322 | 0.9130 | 0.5859 | 0.665 | 0.6230 | 0.2093 | 0.36 | 0.2647 | 0.8922 | 0.9198 | 0.9058 | 0.4074 | 0.1594 | 0.2292 | 0.3529 | 0.4444 | 0.3934 | 0.7616 | 0.7858 | 0.7735 | 0.2778 | 0.4 | 0.3279 | 0.9333 | 0.9506 | 0.9419 | 0.6471 | 0.1667 | 0.2651 | 0.6667 | 0.5185 | 0.5833 | 0.5762 | 0.6619 | 0.6161 | 0.2333 | 0.3333 | 0.2745 | 0.9030 | 0.9255 | 0.9141 | 0.4762 | 0.1923 | 0.2740 | 0.2174 | 0.3571 | 0.2703 | 0.5241 | 0.6973 |
| 0.2544 | 7.0 | 875 | 0.3519 | 0.5992 | 0.6670 | 0.6313 | 0.9127 | 0.5663 | 0.6833 | 0.6193 | 0.1471 | 0.2 | 0.1695 | 0.9042 | 0.9321 | 0.9179 | 0.3947 | 0.2174 | 0.2804 | 0.4 | 0.2963 | 0.3404 | 0.7245 | 0.8283 | 0.7729 | 0.2593 | 0.28 | 0.2692 | 0.9448 | 0.9506 | 0.9477 | 0.6538 | 0.2576 | 0.3696 | 0.7857 | 0.4074 | 0.5366 | 0.5613 | 0.6619 | 0.6075 | 0.1818 | 0.1905 | 0.1860 | 0.9146 | 0.9317 | 0.9231 | 0.4138 | 0.2308 | 0.2963 | 0.2308 | 0.2143 | 0.2222 | 0.5131 | 0.6977 |
| 0.0853 | 8.0 | 1000 | 0.3881 | 0.5996 | 0.6546 | 0.6259 | 0.9138 | 0.5928 | 0.655 | 0.6223 | 0.0769 | 0.12 | 0.0938 | 0.8817 | 0.9198 | 0.9003 | 0.3284 | 0.3188 | 0.3235 | 0.4231 | 0.4074 | 0.4151 | 0.7560 | 0.7788 | 0.7672 | 0.25 | 0.32 | 0.2807 | 0.9337 | 0.9568 | 0.9451 | 0.5957 | 0.4242 | 0.4956 | 0.6190 | 0.4815 | 0.5417 | 0.5890 | 0.6334 | 0.6104 | 0.0417 | 0.0476 | 0.0444 | 0.8970 | 0.9193 | 0.9080 | 0.3654 | 0.3654 | 0.3654 | 0.4545 | 0.3571 | 0.4 | 0.5358 | 0.7022 |
| 0.0853 | 9.0 | 1125 | 0.4068 | 0.5875 | 0.6580 | 0.6207 | 0.9109 | 0.5625 | 0.66 | 0.6074 | 0.1818 | 0.4 | 0.2500 | 0.9146 | 0.9259 | 0.9202 | 0.3421 | 0.1884 | 0.2430 | 0.4286 | 0.4444 | 0.4364 | 0.7138 | 0.7947 | 0.7521 | 0.2340 | 0.44 | 0.3056 | 0.9390 | 0.9506 | 0.9448 | 0.6522 | 0.2273 | 0.3371 | 0.5714 | 0.4444 | 0.5 | 0.5546 | 0.6314 | 0.5905 | 0.1944 | 0.3333 | 0.2456 | 0.9202 | 0.9317 | 0.9259 | 0.3929 | 0.2115 | 0.275 | 0.3158 | 0.4286 | 0.3636 | 0.5240 | 0.6849 |
| 0.0853 | 10.0 | 1250 | 0.4256 | 0.6337 | 0.6682 | 0.6505 | 0.9140 | 0.6069 | 0.6717 | 0.6377 | 0.2432 | 0.36 | 0.2903 | 0.9130 | 0.9074 | 0.9102 | 0.4706 | 0.2319 | 0.3107 | 0.4286 | 0.5556 | 0.4839 | 0.7530 | 0.7717 | 0.7622 | 0.3125 | 0.4 | 0.3509 | 0.9497 | 0.9321 | 0.9408 | 0.6667 | 0.2424 | 0.3556 | 0.5152 | 0.6296 | 0.5667 | 0.5930 | 0.6558 | 0.6228 | 0.2609 | 0.2857 | 0.2727 | 0.9245 | 0.9130 | 0.9187 | 0.5769 | 0.2885 | 0.3846 | 0.4211 | 0.5714 | 0.4848 | 0.5660 | 0.7051 |
| 0.0853 | 11.0 | 1375 | 0.4426 | 0.6211 | 0.6387 | 0.6298 | 0.9093 | 0.5899 | 0.645 | 0.6162 | 0.1944 | 0.28 | 0.2295 | 0.8916 | 0.9136 | 0.9024 | 0.3929 | 0.1594 | 0.2268 | 0.5 | 0.4074 | 0.4490 | 0.7522 | 0.7469 | 0.7496 | 0.2059 | 0.28 | 0.2373 | 0.9383 | 0.9383 | 0.9383 | 0.5455 | 0.1818 | 0.2727 | 0.6667 | 0.4444 | 0.5333 | 0.5704 | 0.6191 | 0.5938 | 0.2 | 0.2381 | 0.2174 | 0.9080 | 0.9193 | 0.9136 | 0.5714 | 0.2308 | 0.3288 | 0.4286 | 0.4286 | 0.4286 | 0.5213 | 0.6819 |
| 0.0307 | 12.0 | 1500 | 0.4234 | 0.6211 | 0.6852 | 0.6516 | 0.9144 | 0.5848 | 0.6783 | 0.6281 | 0.2143 | 0.24 | 0.2264 | 0.9096 | 0.9321 | 0.9207 | 0.5 | 0.3913 | 0.4390 | 0.4667 | 0.5185 | 0.4912 | 0.7471 | 0.8 | 0.7726 | 0.2857 | 0.24 | 0.2609 | 0.9448 | 0.9506 | 0.9477 | 0.5957 | 0.4242 | 0.4956 | 0.6364 | 0.5185 | 0.5714 | 0.5754 | 0.6680 | 0.6183 | 0.2609 | 0.2857 | 0.2727 | 0.9207 | 0.9379 | 0.9292 | 0.5641 | 0.4231 | 0.4835 | 0.2857 | 0.4286 | 0.3429 | 0.5695 | 0.7156 |
| 0.0307 | 13.0 | 1625 | 0.4559 | 0.6220 | 0.6784 | 0.6490 | 0.9127 | 0.6059 | 0.6817 | 0.6416 | 0.2188 | 0.28 | 0.2456 | 0.9042 | 0.9321 | 0.9179 | 0.3846 | 0.2899 | 0.3306 | 0.3243 | 0.4444 | 0.375 | 0.7547 | 0.7841 | 0.7691 | 0.2667 | 0.32 | 0.2909 | 0.9448 | 0.9506 | 0.9477 | 0.5476 | 0.3485 | 0.4259 | 0.5161 | 0.5926 | 0.5517 | 0.6 | 0.6660 | 0.6313 | 0.16 | 0.1905 | 0.1739 | 0.9152 | 0.9379 | 0.9264 | 0.4474 | 0.3269 | 0.3778 | 0.1923 | 0.3571 | 0.25 | 0.5345 | 0.7098 |
| 0.0307 | 14.0 | 1750 | 0.4551 | 0.6031 | 0.6523 | 0.6268 | 0.9127 | 0.5842 | 0.6417 | 0.6116 | 0.1458 | 0.28 | 0.1918 | 0.9152 | 0.9321 | 0.9235 | 0.2979 | 0.2029 | 0.2414 | 0.5278 | 0.7037 | 0.6032 | 0.7496 | 0.7735 | 0.7613 | 0.2051 | 0.32 | 0.25 | 0.9565 | 0.9506 | 0.9536 | 0.5143 | 0.2727 | 0.3564 | 0.6 | 0.6667 | 0.6316 | 0.5768 | 0.6273 | 0.6010 | 0.1290 | 0.1905 | 0.1538 | 0.9264 | 0.9379 | 0.9321 | 0.3889 | 0.2692 | 0.3182 | 0.3478 | 0.5714 | 0.4324 | 0.5390 | 0.6960 |
| 0.0307 | 15.0 | 1875 | 0.4709 | 0.6046 | 0.6806 | 0.6404 | 0.9135 | 0.5872 | 0.6733 | 0.6273 | 0.1961 | 0.4 | 0.2632 | 0.8902 | 0.9506 | 0.9194 | 0.425 | 0.2464 | 0.3119 | 0.3810 | 0.5926 | 0.4638 | 0.7492 | 0.7929 | 0.7704 | 0.2128 | 0.4 | 0.2778 | 0.9286 | 0.9630 | 0.9455 | 0.5806 | 0.2727 | 0.3711 | 0.5758 | 0.7037 | 0.6333 | 0.5761 | 0.6395 | 0.6062 | 0.1892 | 0.3333 | 0.2414 | 0.9 | 0.9503 | 0.9245 | 0.4839 | 0.2885 | 0.3614 | 0.3214 | 0.6429 | 0.4286 | 0.5560 | 0.7029 |
| 0.0136 | 16.0 | 2000 | 0.5190 | 0.6193 | 0.6818 | 0.6491 | 0.9133 | 0.6 | 0.69 | 0.6419 | 0.2045 | 0.36 | 0.2609 | 0.8779 | 0.9321 | 0.9042 | 0.3824 | 0.1884 | 0.2524 | 0.4688 | 0.5556 | 0.5085 | 0.7401 | 0.7965 | 0.7673 | 0.2308 | 0.36 | 0.2812 | 0.9509 | 0.9568 | 0.9538 | 0.5357 | 0.2273 | 0.3191 | 0.6667 | 0.5926 | 0.6275 | 0.5875 | 0.6701 | 0.6261 | 0.2333 | 0.3333 | 0.2745 | 0.8895 | 0.9503 | 0.9189 | 0.5238 | 0.2115 | 0.3014 | 0.35 | 0.5 | 0.4118 | 0.5482 | 0.7043 |
| 0.0136 | 17.0 | 2125 | 0.5312 | 0.6206 | 0.6818 | 0.6498 | 0.9154 | 0.5974 | 0.695 | 0.6425 | 0.2105 | 0.32 | 0.2540 | 0.9259 | 0.9259 | 0.9259 | 0.3846 | 0.2174 | 0.2778 | 0.3636 | 0.4444 | 0.4000 | 0.7302 | 0.8 | 0.7635 | 0.2857 | 0.4 | 0.3333 | 0.9563 | 0.9444 | 0.9503 | 0.5926 | 0.2424 | 0.3441 | 0.6087 | 0.5185 | 0.5600 | 0.5832 | 0.6497 | 0.6146 | 0.2 | 0.2381 | 0.2174 | 0.9371 | 0.9255 | 0.9313 | 0.4062 | 0.25 | 0.3095 | 0.2727 | 0.4286 | 0.3333 | 0.5357 | 0.6998 |
| 0.0136 | 18.0 | 2250 | 0.5362 | 0.6235 | 0.6546 | 0.6387 | 0.9127 | 0.5976 | 0.6533 | 0.6242 | 0.2581 | 0.32 | 0.2857 | 0.9096 | 0.9321 | 0.9207 | 0.4186 | 0.2609 | 0.3214 | 0.2903 | 0.3333 | 0.3103 | 0.7513 | 0.7646 | 0.7579 | 0.2667 | 0.32 | 0.2909 | 0.9627 | 0.9568 | 0.9598 | 0.5556 | 0.3030 | 0.3922 | 0.44 | 0.4074 | 0.4231 | 0.5830 | 0.6293 | 0.6053 | 0.2632 | 0.2381 | 0.25 | 0.9202 | 0.9317 | 0.9259 | 0.4688 | 0.2885 | 0.3571 | 0.2273 | 0.3571 | 0.2778 | 0.5240 | 0.6959 |
| 0.0136 | 19.0 | 2375 | 0.5420 | 0.6261 | 0.6297 | 0.6279 | 0.9154 | 0.5917 | 0.64 | 0.6149 | 0.1944 | 0.28 | 0.2295 | 0.9423 | 0.9074 | 0.9245 | 0.2857 | 0.0870 | 0.1333 | 0.4615 | 0.4444 | 0.4528 | 0.7645 | 0.7469 | 0.7556 | 0.2424 | 0.32 | 0.2759 | 0.9744 | 0.9383 | 0.9560 | 0.3889 | 0.1061 | 0.1667 | 0.5833 | 0.5185 | 0.5490 | 0.5704 | 0.6191 | 0.5938 | 0.2083 | 0.2381 | 0.2222 | 0.9484 | 0.9130 | 0.9304 | 0.375 | 0.1154 | 0.1765 | 0.3333 | 0.4286 | 0.375 | 0.5001 | 0.6786 |
| 0.0059 | 20.0 | 2500 | 0.5872 | 0.6138 | 0.6874 | 0.6485 | 0.9106 | 0.6011 | 0.7083 | 0.6503 | 0.1628 | 0.28 | 0.2059 | 0.9042 | 0.9321 | 0.9179 | 0.3243 | 0.1739 | 0.2264 | 0.3429 | 0.4444 | 0.3871 | 0.7212 | 0.8195 | 0.7672 | 0.25 | 0.4 | 0.3077 | 0.9394 | 0.9568 | 0.9480 | 0.4828 | 0.2121 | 0.2947 | 0.56 | 0.5185 | 0.5385 | 0.5819 | 0.6660 | 0.6211 | 0.1379 | 0.1905 | 0.16 | 0.9036 | 0.9317 | 0.9174 | 0.3571 | 0.1923 | 0.25 | 0.25 | 0.4286 | 0.3158 | 0.5120 | 0.6958 |
| 0.0059 | 21.0 | 2625 | 0.5642 | 0.6088 | 0.6557 | 0.6314 | 0.9126 | 0.5913 | 0.6533 | 0.6207 | 0.2 | 0.36 | 0.2571 | 0.9080 | 0.9136 | 0.9108 | 0.4286 | 0.2174 | 0.2885 | 0.3333 | 0.5556 | 0.4167 | 0.7671 | 0.7752 | 0.7711 | 0.2381 | 0.4 | 0.2985 | 0.9441 | 0.9383 | 0.9412 | 0.6897 | 0.3030 | 0.4211 | 0.4595 | 0.6296 | 0.5312 | 0.5730 | 0.6314 | 0.6008 | 0.1818 | 0.2857 | 0.2222 | 0.9141 | 0.9255 | 0.9198 | 0.4286 | 0.2308 | 0.3 | 0.2308 | 0.4286 | 0.3 | 0.5306 | 0.6978 |
| 0.0059 | 22.0 | 2750 | 0.5869 | 0.6190 | 0.6716 | 0.6442 | 0.9133 | 0.6092 | 0.6833 | 0.6441 | 0.1951 | 0.32 | 0.2424 | 0.9030 | 0.9198 | 0.9113 | 0.2895 | 0.1594 | 0.2056 | 0.3659 | 0.5556 | 0.4412 | 0.7564 | 0.7805 | 0.7683 | 0.2308 | 0.36 | 0.2812 | 0.9444 | 0.9444 | 0.9444 | 0.5714 | 0.2424 | 0.3404 | 0.5484 | 0.6296 | 0.5862 | 0.5930 | 0.6558 | 0.6228 | 0.1562 | 0.2381 | 0.1887 | 0.9030 | 0.9255 | 0.9141 | 0.2414 | 0.1346 | 0.1728 | 0.2593 | 0.5 | 0.3415 | 0.5161 | 0.6964 |
| 0.0059 | 23.0 | 2875 | 0.5873 | 0.6149 | 0.6546 | 0.6341 | 0.9112 | 0.5964 | 0.655 | 0.6243 | 0.2105 | 0.32 | 0.2540 | 0.9096 | 0.9321 | 0.9207 | 0.4 | 0.2029 | 0.2692 | 0.2857 | 0.4444 | 0.3478 | 0.7597 | 0.7611 | 0.7604 | 0.2222 | 0.32 | 0.2623 | 0.9390 | 0.9506 | 0.9448 | 0.7 | 0.3182 | 0.4375 | 0.4828 | 0.5185 | 0.5 | 0.5680 | 0.6212 | 0.5934 | 0.2222 | 0.2857 | 0.25 | 0.9146 | 0.9317 | 0.9231 | 0.4783 | 0.2115 | 0.2933 | 0.1875 | 0.4286 | 0.2609 | 0.5226 | 0.6917 |
| 0.0024 | 24.0 | 3000 | 0.6273 | 0.6126 | 0.6806 | 0.6448 | 0.9103 | 0.5983 | 0.695 | 0.6430 | 0.1842 | 0.28 | 0.2222 | 0.8929 | 0.9259 | 0.9091 | 0.3171 | 0.1884 | 0.2364 | 0.3784 | 0.5185 | 0.4375 | 0.7234 | 0.8053 | 0.7621 | 0.2581 | 0.32 | 0.2857 | 0.9390 | 0.9506 | 0.9448 | 0.5455 | 0.2727 | 0.3636 | 0.5161 | 0.5926 | 0.5517 | 0.5893 | 0.6721 | 0.6280 | 0.1923 | 0.2381 | 0.2128 | 0.9042 | 0.9379 | 0.9207 | 0.375 | 0.1731 | 0.2368 | 0.2857 | 0.4286 | 0.3429 | 0.5249 | 0.6994 |
| 0.0024 | 25.0 | 3125 | 0.6096 | 0.6133 | 0.6682 | 0.6396 | 0.9102 | 0.5985 | 0.6783 | 0.6359 | 0.1892 | 0.28 | 0.2258 | 0.8976 | 0.9198 | 0.9085 | 0.2955 | 0.1884 | 0.2301 | 0.4 | 0.5185 | 0.4516 | 0.7534 | 0.7788 | 0.7659 | 0.2286 | 0.32 | 0.2667 | 0.9503 | 0.9444 | 0.9474 | 0.4857 | 0.2576 | 0.3366 | 0.5769 | 0.5556 | 0.5660 | 0.5750 | 0.6477 | 0.6092 | 0.1481 | 0.1905 | 0.1667 | 0.9091 | 0.9317 | 0.9202 | 0.2903 | 0.1731 | 0.2169 | 0.2 | 0.3571 | 0.2564 | 0.5052 | 0.6919 |
| 0.0024 | 26.0 | 3250 | 0.6085 | 0.6352 | 0.6784 | 0.6561 | 0.9153 | 0.6150 | 0.6817 | 0.6466 | 0.2162 | 0.32 | 0.2581 | 0.8876 | 0.9259 | 0.9063 | 0.4359 | 0.2464 | 0.3148 | 0.4545 | 0.5556 | 0.5 | 0.7695 | 0.7858 | 0.7776 | 0.2353 | 0.32 | 0.2712 | 0.9277 | 0.9506 | 0.9390 | 0.6111 | 0.3333 | 0.4314 | 0.6154 | 0.5926 | 0.6038 | 0.6011 | 0.6660 | 0.6319 | 0.1923 | 0.2381 | 0.2128 | 0.8994 | 0.9441 | 0.9212 | 0.4231 | 0.2115 | 0.2821 | 0.3158 | 0.4286 | 0.3636 | 0.5434 | 0.7107 |
| 0.0024 | 27.0 | 3375 | 0.6359 | 0.6191 | 0.6682 | 0.6427 | 0.9123 | 0.6015 | 0.6767 | 0.6369 | 0.1842 | 0.28 | 0.2222 | 0.9091 | 0.9259 | 0.9174 | 0.3171 | 0.1884 | 0.2364 | 0.4118 | 0.5185 | 0.4590 | 0.7383 | 0.7841 | 0.7605 | 0.2353 | 0.32 | 0.2712 | 0.9387 | 0.9444 | 0.9415 | 0.5625 | 0.2727 | 0.3673 | 0.5357 | 0.5556 | 0.5455 | 0.5849 | 0.6456 | 0.6137 | 0.1538 | 0.1905 | 0.1702 | 0.9085 | 0.9255 | 0.9169 | 0.36 | 0.1731 | 0.2338 | 0.2609 | 0.4286 | 0.3243 | 0.5145 | 0.6927 |
| 0.0012 | 28.0 | 3500 | 0.6558 | 0.6220 | 0.6670 | 0.6437 | 0.9129 | 0.6080 | 0.68 | 0.6420 | 0.1707 | 0.28 | 0.2121 | 0.9030 | 0.9198 | 0.9113 | 0.3421 | 0.1884 | 0.2430 | 0.375 | 0.4444 | 0.4068 | 0.7688 | 0.7770 | 0.7729 | 0.2286 | 0.32 | 0.2667 | 0.9387 | 0.9444 | 0.9415 | 0.5758 | 0.2879 | 0.3838 | 0.5185 | 0.5185 | 0.5185 | 0.5814 | 0.6619 | 0.6190 | 0.1613 | 0.2381 | 0.1923 | 0.9085 | 0.9255 | 0.9169 | 0.3636 | 0.1538 | 0.2162 | 0.3 | 0.4286 | 0.3529 | 0.5181 | 0.6989 |
| 0.0012 | 29.0 | 3625 | 0.6434 | 0.6277 | 0.6625 | 0.6446 | 0.9142 | 0.6054 | 0.67 | 0.6361 | 0.175 | 0.28 | 0.2154 | 0.9030 | 0.9198 | 0.9113 | 0.4 | 0.1739 | 0.2424 | 0.4545 | 0.5556 | 0.5 | 0.7599 | 0.7788 | 0.7692 | 0.2571 | 0.36 | 0.3 | 0.9444 | 0.9444 | 0.9444 | 0.625 | 0.2273 | 0.3333 | 0.5517 | 0.5926 | 0.5714 | 0.5824 | 0.6477 | 0.6133 | 0.1379 | 0.1905 | 0.16 | 0.9085 | 0.9255 | 0.9169 | 0.4 | 0.1538 | 0.2222 | 0.3333 | 0.4286 | 0.375 | 0.5206 | 0.6954 |
| 0.0012 | 30.0 | 3750 | 0.6456 | 0.6324 | 0.6625 | 0.6471 | 0.9152 | 0.6076 | 0.6683 | 0.6365 | 0.1892 | 0.28 | 0.2258 | 0.9036 | 0.9259 | 0.9146 | 0.4 | 0.2029 | 0.2692 | 0.4815 | 0.4815 | 0.4815 | 0.7570 | 0.7611 | 0.7590 | 0.2353 | 0.32 | 0.2712 | 0.9273 | 0.9444 | 0.9358 | 0.5484 | 0.2576 | 0.3505 | 0.6087 | 0.5185 | 0.5600 | 0.5860 | 0.6456 | 0.6143 | 0.1481 | 0.1905 | 0.1667 | 0.9030 | 0.9255 | 0.9141 | 0.4091 | 0.1731 | 0.2432 | 0.3529 | 0.4286 | 0.3871 | 0.5202 | 0.6918 |
| 0.0012 | 31.0 | 3875 | 0.6698 | 0.6266 | 0.6670 | 0.6462 | 0.9126 | 0.6048 | 0.6733 | 0.6372 | 0.2 | 0.28 | 0.2333 | 0.8982 | 0.9259 | 0.9119 | 0.3590 | 0.2029 | 0.2593 | 0.4516 | 0.5185 | 0.4828 | 0.7513 | 0.7805 | 0.7656 | 0.2581 | 0.32 | 0.2857 | 0.9333 | 0.9506 | 0.9419 | 0.5152 | 0.2576 | 0.3434 | 0.5357 | 0.5556 | 0.5455 | 0.5839 | 0.6517 | 0.6160 | 0.1667 | 0.1905 | 0.1778 | 0.8982 | 0.9317 | 0.9146 | 0.4348 | 0.1923 | 0.2667 | 0.3529 | 0.4286 | 0.3871 | 0.5244 | 0.6960 |
| 0.0006 | 32.0 | 4000 | 0.6512 | 0.6253 | 0.6727 | 0.6481 | 0.9143 | 0.6119 | 0.6833 | 0.6457 | 0.1842 | 0.28 | 0.2222 | 0.9042 | 0.9321 | 0.9179 | 0.3171 | 0.1884 | 0.2364 | 0.3824 | 0.4815 | 0.4262 | 0.7539 | 0.7752 | 0.7644 | 0.2353 | 0.32 | 0.2712 | 0.9387 | 0.9444 | 0.9415 | 0.5152 | 0.2576 | 0.3434 | 0.5357 | 0.5556 | 0.5455 | 0.5851 | 0.6578 | 0.6194 | 0.1481 | 0.1905 | 0.1667 | 0.9036 | 0.9317 | 0.9174 | 0.3704 | 0.1923 | 0.2532 | 0.3 | 0.4286 | 0.3529 | 0.5176 | 0.6957 |
| 0.0006 | 33.0 | 4125 | 0.6629 | 0.6432 | 0.6636 | 0.6533 | 0.9169 | 0.6289 | 0.6667 | 0.6472 | 0.2059 | 0.28 | 0.2373 | 0.9036 | 0.9259 | 0.9146 | 0.3721 | 0.2319 | 0.2857 | 0.4062 | 0.4815 | 0.4407 | 0.7822 | 0.7628 | 0.7724 | 0.2581 | 0.32 | 0.2857 | 0.9273 | 0.9444 | 0.9358 | 0.6316 | 0.3636 | 0.4615 | 0.5769 | 0.5556 | 0.5660 | 0.6031 | 0.6436 | 0.6227 | 0.1538 | 0.1905 | 0.1702 | 0.9091 | 0.9317 | 0.9202 | 0.3929 | 0.2115 | 0.275 | 0.2727 | 0.4286 | 0.3333 | 0.5343 | 0.7054 |
| 0.0006 | 34.0 | 4250 | 0.6629 | 0.6356 | 0.6716 | 0.6531 | 0.9149 | 0.6138 | 0.6833 | 0.6467 | 0.2059 | 0.28 | 0.2373 | 0.9091 | 0.9259 | 0.9174 | 0.3514 | 0.1884 | 0.2453 | 0.4483 | 0.4815 | 0.4643 | 0.75 | 0.7752 | 0.7624 | 0.2581 | 0.32 | 0.2857 | 0.9503 | 0.9444 | 0.9474 | 0.5152 | 0.2576 | 0.3434 | 0.56 | 0.5185 | 0.5385 | 0.5923 | 0.6599 | 0.6243 | 0.2 | 0.2381 | 0.2174 | 0.9152 | 0.9379 | 0.9264 | 0.3913 | 0.1731 | 0.24 | 0.375 | 0.4286 | 0.4000 | 0.5285 | 0.6988 |
| 0.0006 | 35.0 | 4375 | 0.6643 | 0.6373 | 0.6727 | 0.6545 | 0.9155 | 0.6156 | 0.6833 | 0.6477 | 0.2059 | 0.28 | 0.2373 | 0.9036 | 0.9259 | 0.9146 | 0.3514 | 0.1884 | 0.2453 | 0.4828 | 0.5185 | 0.5 | 0.7509 | 0.7735 | 0.7620 | 0.2581 | 0.32 | 0.2857 | 0.9444 | 0.9444 | 0.9444 | 0.5 | 0.2576 | 0.3400 | 0.5769 | 0.5556 | 0.5660 | 0.5905 | 0.6578 | 0.6224 | 0.2 | 0.2381 | 0.2174 | 0.9096 | 0.9379 | 0.9235 | 0.3913 | 0.1731 | 0.24 | 0.4 | 0.4286 | 0.4138 | 0.5315 | 0.6979 |
| 0.0005 | 36.0 | 4500 | 0.6727 | 0.6329 | 0.6716 | 0.6516 | 0.9140 | 0.6077 | 0.6817 | 0.6426 | 0.2424 | 0.32 | 0.2759 | 0.9091 | 0.9259 | 0.9174 | 0.3421 | 0.1884 | 0.2430 | 0.4643 | 0.4815 | 0.4727 | 0.7457 | 0.7735 | 0.7593 | 0.2581 | 0.32 | 0.2857 | 0.9563 | 0.9444 | 0.9503 | 0.5 | 0.2424 | 0.3265 | 0.56 | 0.5185 | 0.5385 | 0.5794 | 0.6538 | 0.6144 | 0.2083 | 0.2381 | 0.2222 | 0.9152 | 0.9379 | 0.9264 | 0.4 | 0.1923 | 0.2597 | 0.3529 | 0.4286 | 0.3871 | 0.5270 | 0.6948 |
| 0.0005 | 37.0 | 4625 | 0.6779 | 0.6390 | 0.6716 | 0.6549 | 0.9142 | 0.6150 | 0.6817 | 0.6466 | 0.2424 | 0.32 | 0.2759 | 0.9091 | 0.9259 | 0.9174 | 0.3611 | 0.1884 | 0.2476 | 0.4483 | 0.4815 | 0.4643 | 0.7470 | 0.7735 | 0.76 | 0.2581 | 0.32 | 0.2857 | 0.9563 | 0.9444 | 0.9503 | 0.5 | 0.2273 | 0.3125 | 0.5185 | 0.5185 | 0.5185 | 0.5894 | 0.6578 | 0.6218 | 0.2083 | 0.2381 | 0.2222 | 0.9152 | 0.9379 | 0.9264 | 0.4167 | 0.1923 | 0.2632 | 0.375 | 0.4286 | 0.4000 | 0.5261 | 0.6967 |
| 0.0005 | 38.0 | 4750 | 0.6804 | 0.6429 | 0.6727 | 0.6574 | 0.9147 | 0.6210 | 0.68 | 0.6492 | 0.25 | 0.32 | 0.2807 | 0.9036 | 0.9259 | 0.9146 | 0.3684 | 0.2029 | 0.2617 | 0.4516 | 0.5185 | 0.4828 | 0.7534 | 0.7735 | 0.7633 | 0.2581 | 0.32 | 0.2857 | 0.9563 | 0.9444 | 0.9503 | 0.5 | 0.2576 | 0.3400 | 0.5172 | 0.5556 | 0.5357 | 0.5967 | 0.6599 | 0.6267 | 0.2174 | 0.2381 | 0.2273 | 0.9096 | 0.9379 | 0.9235 | 0.4 | 0.1923 | 0.2597 | 0.3529 | 0.4286 | 0.3871 | 0.5299 | 0.7004 |
| 0.0005 | 39.0 | 4875 | 0.6818 | 0.6421 | 0.6704 | 0.6560 | 0.9147 | 0.6170 | 0.6767 | 0.6455 | 0.2581 | 0.32 | 0.2857 | 0.9036 | 0.9259 | 0.9146 | 0.4054 | 0.2174 | 0.2830 | 0.4333 | 0.4815 | 0.4561 | 0.7522 | 0.7735 | 0.7627 | 0.2667 | 0.32 | 0.2909 | 0.9563 | 0.9444 | 0.9503 | 0.5294 | 0.2727 | 0.36 | 0.5 | 0.5185 | 0.5091 | 0.5938 | 0.6578 | 0.6242 | 0.2174 | 0.2381 | 0.2273 | 0.9096 | 0.9379 | 0.9235 | 0.4 | 0.1923 | 0.2597 | 0.375 | 0.4286 | 0.4000 | 0.5308 | 0.6999 |
| 0.0002 | 40.0 | 5000 | 0.6830 | 0.6428 | 0.6704 | 0.6563 | 0.9147 | 0.6180 | 0.6767 | 0.6460 | 0.2581 | 0.32 | 0.2857 | 0.9036 | 0.9259 | 0.9146 | 0.4054 | 0.2174 | 0.2830 | 0.4333 | 0.4815 | 0.4561 | 0.7509 | 0.7735 | 0.7620 | 0.2667 | 0.32 | 0.2909 | 0.9563 | 0.9444 | 0.9503 | 0.5312 | 0.2576 | 0.3469 | 0.5 | 0.5185 | 0.5091 | 0.5959 | 0.6578 | 0.6254 | 0.2174 | 0.2381 | 0.2273 | 0.9096 | 0.9379 | 0.9235 | 0.4 | 0.1923 | 0.2597 | 0.375 | 0.4286 | 0.4000 | 0.5295 | 0.6995 |
### Framework versions
- Transformers 4.35.2
- Pytorch 2.1.0+cu118
- Datasets 2.15.0
- Tokenizers 0.15.0
|