Theoreticallyhugo commited on
Commit
bdcf19b
·
verified ·
1 Parent(s): bfb2f7d

trainer: training complete at 2024-03-04 09:19:26.367435.

Browse files
Files changed (2) hide show
  1. README.md +62 -62
  2. meta_data/README_s42_e50.md +62 -62
README.md CHANGED
@@ -17,12 +17,12 @@ model-index:
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
- split: train[0%:20%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
- value: 0.8424353991954728
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,14 +32,14 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 1.2704
36
- - Claim: {'precision': 0.5972354623450906, 'recall': 0.5879868606288128, 'f1-score': 0.5925750768503193, 'support': 4262.0}
37
- - Majorclaim: {'precision': 0.8091328886608518, 'recall': 0.7284064665127021, 'f1-score': 0.7666504618376278, 'support': 2165.0}
38
- - O: {'precision': 0.9211161229413616, 'recall': 0.8898459667612485, 'f1-score': 0.9052110715942477, 'support': 9868.0}
39
- - Premise: {'precision': 0.8676039835969537, 'recall': 0.9086586394662167, 'f1-score': 0.8876568645813823, 'support': 13039.0}
40
- - Accuracy: 0.8424
41
- - Macro avg: {'precision': 0.7987721143860643, 'recall': 0.7787244833422451, 'f1-score': 0.7880233687158943, 'support': 29334.0}
42
- - Weighted avg: {'precision': 0.8420076528182845, 'recall': 0.8424353991954728, 'f1-score': 0.8417581625139158, 'support': 29334.0}
43
 
44
  ## Model description
45
 
@@ -68,58 +68,58 @@ The following hyperparameters were used during training:
68
 
69
  ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
- |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
- | No log | 1.0 | 81 | 0.5471 | {'precision': 0.45446915652538816, 'recall': 0.5082121069920226, 'f1-score': 0.4798404962339389, 'support': 4262.0} | {'precision': 0.5914396887159533, 'recall': 0.6318706697459584, 'f1-score': 0.6109870477891916, 'support': 2165.0} | {'precision': 0.9164132026585559, 'recall': 0.8243818402918525, 'f1-score': 0.8679647906108295, 'support': 9868.0} | {'precision': 0.852593810734041, 'recall': 0.8747603343814709, 'f1-score': 0.8635348449861832, 'support': 13039.0} | 0.7866 | {'precision': 0.7037289646584846, 'recall': 0.709806237852826, 'f1-score': 0.7055817949050358, 'support': 29334.0} | {'precision': 0.7969438417255414, 'recall': 0.7866298493216063, 'f1-score': 0.7906379815550267, 'support': 29334.0} |
74
- | No log | 2.0 | 162 | 0.5196 | {'precision': 0.5064490124949617, 'recall': 0.5896292820272173, 'f1-score': 0.5448829141370338, 'support': 4262.0} | {'precision': 0.5564053537284895, 'recall': 0.8064665127020785, 'f1-score': 0.6584951914010938, 'support': 2165.0} | {'precision': 0.9374127501163332, 'recall': 0.8165788406972031, 'f1-score': 0.8728336221837087, 'support': 9868.0} | {'precision': 0.8852666561164741, 'recall': 0.858041260832886, 'f1-score': 0.8714413677610314, 'support': 13039.0} | 0.8013 | {'precision': 0.7213834431140647, 'recall': 0.7676789740648462, 'f1-score': 0.7369132738707169, 'support': 29334.0} | {'precision': 0.8234977919590369, 'recall': 0.8012886070771119, 'f1-score': 0.8087468210056704, 'support': 29334.0} |
75
- | No log | 3.0 | 243 | 0.5239 | {'precision': 0.5717288491854966, 'recall': 0.5105584232754575, 'f1-score': 0.5394149727317799, 'support': 4262.0} | {'precision': 0.7751024590163934, 'recall': 0.6988452655889146, 'f1-score': 0.7350012144765606, 'support': 2165.0} | {'precision': 0.9378775789353699, 'recall': 0.8338062423996757, 'f1-score': 0.8827852583015933, 'support': 9868.0} | {'precision': 0.8284131594946971, 'recall': 0.9404862336068717, 'f1-score': 0.8808993606781121, 'support': 13039.0} | 0.8243 | {'precision': 0.7782805116579892, 'recall': 0.7459240412177299, 'f1-score': 0.7595252015470114, 'support': 29334.0} | {'precision': 0.8240083287170064, 'recall': 0.8242994477398241, 'f1-score': 0.8211507443896716, 'support': 29334.0} |
76
- | No log | 4.0 | 324 | 0.4756 | {'precision': 0.5839096357768557, 'recall': 0.5943219145940872, 'f1-score': 0.5890697674418606, 'support': 4262.0} | {'precision': 0.7539079946404645, 'recall': 0.7796766743648961, 'f1-score': 0.7665758401453224, 'support': 2165.0} | {'precision': 0.9029426948890036, 'recall': 0.8861978111066072, 'f1-score': 0.8944918938270342, 'support': 9868.0} | {'precision': 0.8858629130966952, 'recall': 0.8881049160211673, 'f1-score': 0.8869824977978629, 'support': 13039.0} | 0.8368 | {'precision': 0.7816558096007548, 'recall': 0.7870753290216894, 'f1-score': 0.7842799998030201, 'support': 29334.0} | {'precision': 0.8379981834427648, 'recall': 0.8367764368991614, 'f1-score': 0.8373376573199475, 'support': 29334.0} |
77
- | No log | 5.0 | 405 | 0.5507 | {'precision': 0.5626541134274826, 'recall': 0.5889253871421868, 'f1-score': 0.575490083686805, 'support': 4262.0} | {'precision': 0.7744245524296676, 'recall': 0.6993071593533488, 'f1-score': 0.7349514563106796, 'support': 2165.0} | {'precision': 0.9094442693560247, 'recall': 0.8772800972841508, 'f1-score': 0.893072677567442, 'support': 9868.0} | {'precision': 0.8688708112545712, 'recall': 0.8928598818927832, 'f1-score': 0.8807020198199561, 'support': 13039.0} | 0.8292 | {'precision': 0.7788484366169366, 'recall': 0.7645931314181174, 'f1-score': 0.7710540593462206, 'support': 29334.0} | {'precision': 0.8310582786320232, 'recall': 0.8291743369468876, 'f1-score': 0.8297614869521274, 'support': 29334.0} |
78
- | No log | 6.0 | 486 | 0.6030 | {'precision': 0.5614867536575722, 'recall': 0.666353824495542, 'f1-score': 0.6094420600858369, 'support': 4262.0} | {'precision': 0.7341541267669859, 'recall': 0.74364896073903, 'f1-score': 0.7388710417622762, 'support': 2165.0} | {'precision': 0.918757975329647, 'recall': 0.8755573571139035, 'f1-score': 0.896637608966376, 'support': 9868.0} | {'precision': 0.8982569603281015, 'recall': 0.873456553416673, 'f1-score': 0.8856831790963526, 'support': 13039.0} | 0.8345 | {'precision': 0.7781639540205766, 'recall': 0.7897541739412871, 'f1-score': 0.7826584724777105, 'support': 29334.0} | {'precision': 0.8441118304632907, 'recall': 0.8344923979000477, 'f1-score': 0.8383971078959127, 'support': 29334.0} |
79
- | 0.3501 | 7.0 | 567 | 0.7000 | {'precision': 0.5986996098829649, 'recall': 0.5401220084467386, 'f1-score': 0.5679042802516344, 'support': 4262.0} | {'precision': 0.8235613463626493, 'recall': 0.7006928406466513, 'f1-score': 0.7571749438482656, 'support': 2165.0} | {'precision': 0.9108108108108108, 'recall': 0.8879205512768544, 'f1-score': 0.8992200328407225, 'support': 9868.0} | {'precision': 0.8537819918728167, 'recall': 0.9184753432011658, 'f1-score': 0.8849479051208157, 'support': 13039.0} | 0.8372 | {'precision': 0.7967134397323103, 'recall': 0.7618026858928525, 'f1-score': 0.7773117905153596, 'support': 29334.0} | {'precision': 0.833674661665885, 'recall': 0.8371514283766278, 'f1-score': 0.834254817440735, 'support': 29334.0} |
80
- | 0.3501 | 8.0 | 648 | 0.7253 | {'precision': 0.5610444601270289, 'recall': 0.5595964335992492, 'f1-score': 0.5603195113356043, 'support': 4262.0} | {'precision': 0.8215042372881356, 'recall': 0.7163972286374134, 'f1-score': 0.765358993338268, 'support': 2165.0} | {'precision': 0.9208110992529349, 'recall': 0.8743413052290231, 'f1-score': 0.8969747374987005, 'support': 9868.0} | {'precision': 0.8566365280289331, 'recall': 0.9082751744765702, 'f1-score': 0.8817004169148303, 'support': 13039.0} | 0.8320 | {'precision': 0.7899990811742581, 'recall': 0.764652535485564, 'f1-score': 0.7760884147718508, 'support': 29334.0} | {'precision': 0.8326847950905921, 'recall': 0.8320379082293584, 'f1-score': 0.8315580017617559, 'support': 29334.0} |
81
- | 0.3501 | 9.0 | 729 | 0.7606 | {'precision': 0.575776926351639, 'recall': 0.6346785546691694, 'f1-score': 0.6037946428571428, 'support': 4262.0} | {'precision': 0.7266247379454926, 'recall': 0.8004618937644342, 'f1-score': 0.7617582417582419, 'support': 2165.0} | {'precision': 0.9148418491484185, 'recall': 0.8763680583704905, 'f1-score': 0.8951917602608561, 'support': 9868.0} | {'precision': 0.8901390842319112, 'recall': 0.873686632410461, 'f1-score': 0.8818361264852731, 'support': 13039.0} | 0.8345 | {'precision': 0.7768456494193653, 'recall': 0.7962987848036388, 'f1-score': 0.7856451928403785, 'support': 29334.0} | {'precision': 0.8407065761389229, 'recall': 0.8344583077657326, 'f1-score': 0.8370693701765644, 'support': 29334.0} |
82
- | 0.3501 | 10.0 | 810 | 0.8529 | {'precision': 0.5611362700699877, 'recall': 0.639605818864383, 'f1-score': 0.5978070175438598, 'support': 4262.0} | {'precision': 0.8085327783558793, 'recall': 0.7177829099307159, 'f1-score': 0.760459995106435, 'support': 2165.0} | {'precision': 0.9375900676199977, 'recall': 0.8571139035265505, 'f1-score': 0.8955476732489809, 'support': 9868.0} | {'precision': 0.8664006502623217, 'recall': 0.8992254007209142, 'f1-score': 0.8825079030558481, 'support': 13039.0} | 0.8339 | {'precision': 0.7934149415770466, 'recall': 0.7784320082606409, 'f1-score': 0.7840806472387809, 'support': 29334.0} | {'precision': 0.8417254078619799, 'recall': 0.8339469557510056, 'f1-score': 0.8365219331064127, 'support': 29334.0} |
83
- | 0.3501 | 11.0 | 891 | 0.8182 | {'precision': 0.5611759619541721, 'recall': 0.6091037071797278, 'f1-score': 0.5841584158415842, 'support': 4262.0} | {'precision': 0.745115856428896, 'recall': 0.7575057736720554, 'f1-score': 0.7512597343105818, 'support': 2165.0} | {'precision': 0.9214115609439273, 'recall': 0.8625861370085124, 'f1-score': 0.8910289961268711, 'support': 9868.0} | {'precision': 0.8729369206420982, 'recall': 0.8883349950149552, 'f1-score': 0.8805686483199028, 'support': 13039.0} | 0.8294 | {'precision': 0.7751600749922735, 'recall': 0.7793826532188127, 'f1-score': 0.776753948649735, 'support': 29334.0} | {'precision': 0.8345135873274777, 'recall': 0.8294470580214086, 'f1-score': 0.8314777811523291, 'support': 29334.0} |
84
- | 0.3501 | 12.0 | 972 | 0.8319 | {'precision': 0.5907553551296505, 'recall': 0.6147348662599719, 'f1-score': 0.6025066114752213, 'support': 4262.0} | {'precision': 0.7414772727272727, 'recall': 0.7233256351039261, 'f1-score': 0.7322889876081365, 'support': 2165.0} | {'precision': 0.9154129405576013, 'recall': 0.881738954195379, 'f1-score': 0.8982604655964487, 'support': 9868.0} | {'precision': 0.8792350549616021, 'recall': 0.8956208298182375, 'f1-score': 0.8873523042437597, 'support': 13039.0} | 0.8374 | {'precision': 0.7817201558440317, 'recall': 0.7788550713443787, 'f1-score': 0.7801020922308914, 'support': 29334.0} | {'precision': 0.8393242789283376, 'recall': 0.8374241494511488, 'f1-score': 0.838191511754931, 'support': 29334.0} |
85
- | 0.0592 | 13.0 | 1053 | 0.8901 | {'precision': 0.5857348703170029, 'recall': 0.5722665415297982, 'f1-score': 0.5789223830999287, 'support': 4262.0} | {'precision': 0.765908035299582, 'recall': 0.7616628175519631, 'f1-score': 0.7637795275590551, 'support': 2165.0} | {'precision': 0.9286720867208672, 'recall': 0.8681597081475476, 'f1-score': 0.8973969517624261, 'support': 9868.0} | {'precision': 0.8617314385150812, 'recall': 0.9114962803896004, 'f1-score': 0.8859155454511572, 'support': 13039.0} | 0.8366 | {'precision': 0.7855116077131332, 'recall': 0.7783963369047273, 'f1-score': 0.7815036019681417, 'support': 29334.0} | {'precision': 0.8370779741008496, 'recall': 0.8365718960932707, 'f1-score': 0.8361599437876358, 'support': 29334.0} |
86
- | 0.0592 | 14.0 | 1134 | 1.0014 | {'precision': 0.5823915900131406, 'recall': 0.5199436884091976, 'f1-score': 0.5493987851741663, 'support': 4262.0} | {'precision': 0.7580798479087453, 'recall': 0.7367205542725174, 'f1-score': 0.7472475989693137, 'support': 2165.0} | {'precision': 0.9203320396722725, 'recall': 0.8651195784353466, 'f1-score': 0.8918721270371919, 'support': 9868.0} | {'precision': 0.8481164746625203, 'recall': 0.9203159751514687, 'f1-score': 0.8827423863469177, 'support': 13039.0} | 0.8300 | {'precision': 0.7772299880641695, 'recall': 0.7605249490671326, 'f1-score': 0.7678152243818974, 'support': 29334.0} | {'precision': 0.8271569887491997, 'recall': 0.8300265903047658, 'f1-score': 0.8273812231322469, 'support': 29334.0} |
87
- | 0.0592 | 15.0 | 1215 | 0.9525 | {'precision': 0.5900047370914259, 'recall': 0.5844673862036602, 'f1-score': 0.5872230080150872, 'support': 4262.0} | {'precision': 0.787819253438114, 'recall': 0.7408775981524249, 'f1-score': 0.7636277076886455, 'support': 2165.0} | {'precision': 0.9236014917421417, 'recall': 0.8783948115119579, 'f1-score': 0.9004311016464966, 'support': 9868.0} | {'precision': 0.8681615659922577, 'recall': 0.9115729733875297, 'f1-score': 0.889337822671156, 'support': 13039.0} | 0.8403 | {'precision': 0.7923967620659849, 'recall': 0.7788281923138932, 'f1-score': 0.7851549100053463, 'support': 29334.0} | {'precision': 0.8404679570689874, 'recall': 0.8402877207336197, 'f1-score': 0.8398966533088925, 'support': 29334.0} |
88
- | 0.0592 | 16.0 | 1296 | 0.9606 | {'precision': 0.5905569007263922, 'recall': 0.5722665415297982, 'f1-score': 0.5812678741658723, 'support': 4262.0} | {'precision': 0.6997189883580891, 'recall': 0.805080831408776, 'f1-score': 0.7487113402061856, 'support': 2165.0} | {'precision': 0.9022900763358779, 'recall': 0.8983583299554114, 'f1-score': 0.900319910628142, 'support': 9868.0} | {'precision': 0.8913718187461204, 'recall': 0.8810491602116727, 'f1-score': 0.8861804296679139, 'support': 13039.0} | 0.8364 | {'precision': 0.77098444604162, 'recall': 0.7891887157764146, 'f1-score': 0.7791198886670285, 'support': 29334.0} | {'precision': 0.8371937253222967, 'recall': 0.8364014454216949, 'f1-score': 0.8364896444998899, 'support': 29334.0} |
89
- | 0.0592 | 17.0 | 1377 | 1.0477 | {'precision': 0.5815651380333106, 'recall': 0.5980760206475833, 'f1-score': 0.589705031810295, 'support': 4262.0} | {'precision': 0.7966360856269113, 'recall': 0.7219399538106236, 'f1-score': 0.7574509328810274, 'support': 2165.0} | {'precision': 0.917960088691796, 'recall': 0.8810295905958654, 'f1-score': 0.8991157764103624, 'support': 9868.0} | {'precision': 0.8738718745376535, 'recall': 0.9059743845386916, 'f1-score': 0.889633618255074, 'support': 13039.0} | 0.8393 | {'precision': 0.7925082967224177, 'recall': 0.7767549873981909, 'f1-score': 0.7839763398391897, 'support': 29334.0} | {'precision': 0.8405329403077433, 'recall': 0.8392650167041659, 'f1-score': 0.8394903983537285, 'support': 29334.0} |
90
- | 0.0592 | 18.0 | 1458 | 1.0223 | {'precision': 0.5735161870503597, 'recall': 0.5985452839042703, 'f1-score': 0.5857634902411022, 'support': 4262.0} | {'precision': 0.7626000942063118, 'recall': 0.7478060046189376, 'f1-score': 0.7551305970149254, 'support': 2165.0} | {'precision': 0.9284857734656056, 'recall': 0.8630928252938792, 'f1-score': 0.8945958720655428, 'support': 9868.0} | {'precision': 0.8720382634289919, 'recall': 0.9088887184600046, 'f1-score': 0.8900822411656465, 'support': 13039.0} | 0.8365 | {'precision': 0.7841600795378172, 'recall': 0.7795832080692728, 'f1-score': 0.7813930501218043, 'support': 29334.0} | {'precision': 0.8395772728770206, 'recall': 0.8365037158246403, 'f1-score': 0.83742538167473, 'support': 29334.0} |
91
- | 0.0221 | 19.0 | 1539 | 1.0659 | {'precision': 0.5930577757478876, 'recall': 0.6093383388080713, 'f1-score': 0.6010878370558963, 'support': 4262.0} | {'precision': 0.6994195688225538, 'recall': 0.7792147806004619, 'f1-score': 0.7371640812759448, 'support': 2165.0} | {'precision': 0.922713610991842, 'recall': 0.8710985002026753, 'f1-score': 0.896163469557965, 'support': 9868.0} | {'precision': 0.8897709231118167, 'recall': 0.9025998926298029, 'f1-score': 0.8961394959262925, 'support': 13039.0} | 0.8403 | {'precision': 0.776240469668525, 'recall': 0.7905628780602528, 'f1-score': 0.7826387209540246, 'support': 29334.0} | {'precision': 0.8436938905863776, 'recall': 0.8402877207336197, 'f1-score': 0.8415456672283212, 'support': 29334.0} |
92
- | 0.0221 | 20.0 | 1620 | 1.1141 | {'precision': 0.5949911459650898, 'recall': 0.5518535898639136, 'f1-score': 0.5726110772976263, 'support': 4262.0} | {'precision': 0.8097686375321337, 'recall': 0.7274826789838337, 'f1-score': 0.7664233576642335, 'support': 2165.0} | {'precision': 0.9140376879102265, 'recall': 0.8749493311714633, 'f1-score': 0.8940664802733769, 'support': 9868.0} | {'precision': 0.8566118656182988, 'recall': 0.9190888871846, 'f1-score': 0.8867512671574975, 'support': 13039.0} | 0.8367 | {'precision': 0.7938523342564372, 'recall': 0.7683436218009527, 'f1-score': 0.7799630455981834, 'support': 29334.0} | {'precision': 0.8344612867135542, 'recall': 0.8367423467648463, 'f1-score': 0.8346891927657273, 'support': 29334.0} |
93
- | 0.0221 | 21.0 | 1701 | 1.0835 | {'precision': 0.5811926605504587, 'recall': 0.5945565462224308, 'f1-score': 0.5877986546045001, 'support': 4262.0} | {'precision': 0.8357461024498887, 'recall': 0.6933025404157044, 'f1-score': 0.7578894218631658, 'support': 2165.0} | {'precision': 0.9177489177489178, 'recall': 0.8808269152817186, 'f1-score': 0.8989089404829618, 'support': 9868.0} | {'precision': 0.8672211278908587, 'recall': 0.911649666385459, 'f1-score': 0.8888805802736859, 'support': 13039.0} | 0.8391 | {'precision': 0.8004772021600309, 'recall': 0.7700839170763282, 'f1-score': 0.7833693993060784, 'support': 29334.0} | {'precision': 0.8403380390667924, 'recall': 0.8390945660325901, 'f1-score': 0.8388414732096745, 'support': 29334.0} |
94
- | 0.0221 | 22.0 | 1782 | 1.0930 | {'precision': 0.6045955002393489, 'recall': 0.5926794931956828, 'f1-score': 0.5985781990521326, 'support': 4262.0} | {'precision': 0.7659963436928702, 'recall': 0.7741339491916859, 'f1-score': 0.7700436480588099, 'support': 2165.0} | {'precision': 0.9202473276042759, 'recall': 0.8898459667612485, 'f1-score': 0.9047913446676972, 'support': 9868.0} | {'precision': 0.8782213615373157, 'recall': 0.9042871385842473, 'f1-score': 0.8910636689967883, 'support': 13039.0} | 0.8445 | {'precision': 0.7922651332684526, 'recall': 0.7902366369332161, 'f1-score': 0.7911192151938571, 'support': 29334.0} | {'precision': 0.8443204836707991, 'recall': 0.8445489875230109, 'f1-score': 0.8442539357618283, 'support': 29334.0} |
95
- | 0.0221 | 23.0 | 1863 | 1.1053 | {'precision': 0.6242860690340204, 'recall': 0.5898639136555608, 'f1-score': 0.6065870430691278, 'support': 4262.0} | {'precision': 0.7682088868529546, 'recall': 0.77459584295612, 'f1-score': 0.7713891444342226, 'support': 2165.0} | {'precision': 0.916354556803995, 'recall': 0.8925820835022295, 'f1-score': 0.9043121149897331, 'support': 9868.0} | {'precision': 0.8755180580224985, 'recall': 0.9072781655034895, 'f1-score': 0.8911152122330608, 'support': 13039.0} | 0.8464 | {'precision': 0.7960918926783671, 'recall': 0.79108000140435, 'f1-score': 0.793350878681536, 'support': 29334.0} | {'precision': 0.8448335103073846, 'recall': 0.8464239449103429, 'f1-score': 0.8453785599743056, 'support': 29334.0} |
96
- | 0.0221 | 24.0 | 1944 | 1.1296 | {'precision': 0.5723617064707083, 'recall': 0.657907085875176, 'f1-score': 0.612160244514791, 'support': 4262.0} | {'precision': 0.74928092042186, 'recall': 0.7219399538106236, 'f1-score': 0.7353563867325336, 'support': 2165.0} | {'precision': 0.9411369740376008, 'recall': 0.8522496959870288, 'f1-score': 0.8944905339289514, 'support': 9868.0} | {'precision': 0.8760158055617684, 'recall': 0.9011427256691464, 'f1-score': 0.888401633146832, 'support': 13039.0} | 0.8361 | {'precision': 0.7846988516229843, 'recall': 0.7833098653354937, 'f1-score': 0.7826021995807769, 'support': 29334.0} | {'precision': 0.8444504170660131, 'recall': 0.8361287243471739, 'f1-score': 0.8390187162613489, 'support': 29334.0} |
97
- | 0.0121 | 25.0 | 2025 | 1.1851 | {'precision': 0.5420016077170418, 'recall': 0.6328015016424214, 'f1-score': 0.5838926174496645, 'support': 4262.0} | {'precision': 0.7453046266605589, 'recall': 0.751501154734411, 'f1-score': 0.7483900643974242, 'support': 2165.0} | {'precision': 0.9215119391797837, 'recall': 0.872111876773409, 'f1-score': 0.8961316186806892, 'support': 9868.0} | {'precision': 0.8868806481770022, 'recall': 0.8730730884270266, 'f1-score': 0.8799227053140096, 'support': 13039.0} | 0.8289 | {'precision': 0.7739247054335967, 'recall': 0.782371905394317, 'f1-score': 0.7770842514604469, 'support': 29334.0} | {'precision': 0.8379734082026378, 'recall': 0.8288675257380514, 'f1-score': 0.8326567734615568, 'support': 29334.0} |
98
- | 0.0121 | 26.0 | 2106 | 1.1608 | {'precision': 0.5844748858447488, 'recall': 0.5706241201313937, 'f1-score': 0.5774664608809212, 'support': 4262.0} | {'precision': 0.7811717576364546, 'recall': 0.7205542725173211, 'f1-score': 0.7496395963479097, 'support': 2165.0} | {'precision': 0.9070486397361912, 'recall': 0.8919740575597892, 'f1-score': 0.8994481912936848, 'support': 9868.0} | {'precision': 0.8734412114014252, 'recall': 0.9024465066339443, 'f1-score': 0.887706989551507, 'support': 13039.0} | 0.8373 | {'precision': 0.786534123654705, 'recall': 0.7713997392106121, 'f1-score': 0.7785653095185057, 'support': 29334.0} | {'precision': 0.8359522994181892, 'recall': 0.8372877889138883, 'f1-score': 0.8363911492062416, 'support': 29334.0} |
99
- | 0.0121 | 27.0 | 2187 | 1.2414 | {'precision': 0.5587455830388692, 'recall': 0.5936180197090568, 'f1-score': 0.5756541524459613, 'support': 4262.0} | {'precision': 0.7639377197388247, 'recall': 0.702540415704388, 'f1-score': 0.7319538017324351, 'support': 2165.0} | {'precision': 0.934953934953935, 'recall': 0.8535670855289825, 'f1-score': 0.8924087513905812, 'support': 9868.0} | {'precision': 0.8628857018687527, 'recall': 0.9136436843316206, 'f1-score': 0.8875395790650028, 'support': 13039.0} | 0.8314 | {'precision': 0.7801307349000954, 'recall': 0.7658423013185119, 'f1-score': 0.771889071158495, 'support': 29334.0} | {'precision': 0.8356375173838656, 'recall': 0.8313561055430558, 'f1-score': 0.832380040520428, 'support': 29334.0} |
100
- | 0.0121 | 28.0 | 2268 | 1.1803 | {'precision': 0.5745489078822412, 'recall': 0.5678085405912717, 'f1-score': 0.5711588388010385, 'support': 4262.0} | {'precision': 0.759923481587757, 'recall': 0.7339491916859122, 'f1-score': 0.7467105263157894, 'support': 2165.0} | {'precision': 0.9240980623059629, 'recall': 0.8747466558573166, 'f1-score': 0.8987453797698997, 'support': 9868.0} | {'precision': 0.8636230825420015, 'recall': 0.9067413145179845, 'f1-score': 0.8846571139960342, 'support': 13039.0} | 0.8340 | {'precision': 0.7805483835794906, 'recall': 0.7708114256631212, 'f1-score': 0.7753179647206904, 'support': 29334.0} | {'precision': 0.834313180443581, 'recall': 0.8339810458853207, 'f1-score': 0.8336664204475138, 'support': 29334.0} |
101
- | 0.0121 | 29.0 | 2349 | 1.1596 | {'precision': 0.577922077922078, 'recall': 0.6055842327545753, 'f1-score': 0.5914298808432631, 'support': 4262.0} | {'precision': 0.7678825201326386, 'recall': 0.748729792147806, 'f1-score': 0.7581852198316185, 'support': 2165.0} | {'precision': 0.9200716090985678, 'recall': 0.8853871098500202, 'f1-score': 0.9023961991324106, 'support': 9868.0} | {'precision': 0.8802503581931981, 'recall': 0.8952373648285912, 'f1-score': 0.887680608365019, 'support': 13039.0} | 0.8390 | {'precision': 0.7865316413366206, 'recall': 0.7837346248952481, 'f1-score': 0.7849229770430779, 'support': 29334.0} | {'precision': 0.841427033860259, 'recall': 0.8390263857639599, 'f1-score': 0.8400306231199138, 'support': 29334.0} |
102
- | 0.0121 | 30.0 | 2430 | 1.1079 | {'precision': 0.5908226343319068, 'recall': 0.5830595964335993, 'f1-score': 0.5869154463863959, 'support': 4262.0} | {'precision': 0.7353747714808044, 'recall': 0.7431870669745958, 'f1-score': 0.7392602802664829, 'support': 2165.0} | {'precision': 0.9172500261205726, 'recall': 0.8896432914471017, 'f1-score': 0.903235763156541, 'support': 9868.0} | {'precision': 0.8796469444236666, 'recall': 0.9019096556484393, 'f1-score': 0.8906392002423507, 'support': 13039.0} | 0.8397 | {'precision': 0.7807735940892376, 'recall': 0.779449902625934, 'f1-score': 0.7800126725129426, 'support': 29334.0} | {'precision': 0.8396847417289331, 'recall': 0.8397422785845776, 'f1-score': 0.8395754817639772, 'support': 29334.0} |
103
- | 0.0062 | 31.0 | 2511 | 1.2153 | {'precision': 0.5875237191650854, 'recall': 0.5811825434068513, 'f1-score': 0.5843359282849729, 'support': 4262.0} | {'precision': 0.7917981072555205, 'recall': 0.6956120092378753, 'f1-score': 0.7405950331940004, 'support': 2165.0} | {'precision': 0.9167449139280125, 'recall': 0.8904539927036887, 'f1-score': 0.9034082146712589, 'support': 9868.0} | {'precision': 0.8704423740004402, 'recall': 0.9099624204310146, 'f1-score': 0.889763779527559, 'support': 13039.0} | 0.8398 | {'precision': 0.7916272785872646, 'recall': 0.7693027414448574, 'f1-score': 0.7795257389194479, 'support': 29334.0} | {'precision': 0.8391084038495659, 'recall': 0.8398104588532079, 'f1-score': 0.8389680969813661, 'support': 29334.0} |
104
- | 0.0062 | 32.0 | 2592 | 1.2206 | {'precision': 0.5818530964954393, 'recall': 0.5687470671046457, 'f1-score': 0.5752254390128144, 'support': 4262.0} | {'precision': 0.7966280295047419, 'recall': 0.6983833718244804, 'f1-score': 0.7442776273689393, 'support': 2165.0} | {'precision': 0.9354697582850268, 'recall': 0.8667409809485205, 'f1-score': 0.89979485560991, 'support': 9868.0} | {'precision': 0.8528349968146103, 'recall': 0.9239972390520745, 'f1-score': 0.8869910918059338, 'support': 13039.0} | 0.8365 | {'precision': 0.7916964702749545, 'recall': 0.7644671647324303, 'f1-score': 0.7765722534493993, 'support': 29334.0} | {'precision': 0.8371135433068684, 'recall': 0.8364696256903252, 'f1-score': 0.835468206366078, 'support': 29334.0} |
105
- | 0.0062 | 33.0 | 2673 | 1.2003 | {'precision': 0.5884494054841058, 'recall': 0.5689816987329892, 'f1-score': 0.5785518310867231, 'support': 4262.0} | {'precision': 0.8168557536466775, 'recall': 0.6983833718244804, 'f1-score': 0.7529880478087649, 'support': 2165.0} | {'precision': 0.9152016546018614, 'recall': 0.8968382650993109, 'f1-score': 0.9059269116593306, 'support': 9868.0} | {'precision': 0.8656879929886064, 'recall': 0.9090421044558632, 'f1-score': 0.8868355093337323, 'support': 13039.0} | 0.8400 | {'precision': 0.7965487016803128, 'recall': 0.7683113600281608, 'f1-score': 0.7810755749721379, 'support': 29334.0} | {'precision': 0.8384597989025678, 'recall': 0.8399809095247835, 'f1-score': 0.8385880547506103, 'support': 29334.0} |
106
- | 0.0062 | 34.0 | 2754 | 1.1772 | {'precision': 0.5838150289017341, 'recall': 0.6161426560300328, 'f1-score': 0.5995433789954339, 'support': 4262.0} | {'precision': 0.7706552706552706, 'recall': 0.7496535796766743, 'f1-score': 0.7600093654881762, 'support': 2165.0} | {'precision': 0.9282564268043455, 'recall': 0.8745439805431698, 'f1-score': 0.9006000521784504, 'support': 9868.0} | {'precision': 0.873967095957716, 'recall': 0.9003757956898535, 'f1-score': 0.8869749168933212, 'support': 13039.0} | 0.8393 | {'precision': 0.7891734555797665, 'recall': 0.7851790029849326, 'f1-score': 0.7867819283888454, 'support': 29334.0} | {'precision': 0.8424483431528531, 'recall': 0.8392650167041659, 'f1-score': 0.8404261748765735, 'support': 29334.0} |
107
- | 0.0062 | 35.0 | 2835 | 1.1895 | {'precision': 0.606857679661813, 'recall': 0.6062881276396058, 'f1-score': 0.6065727699530515, 'support': 4262.0} | {'precision': 0.7335437330928765, 'recall': 0.751501154734411, 'f1-score': 0.7424138717773214, 'support': 2165.0} | {'precision': 0.9192592592592592, 'recall': 0.8803202269963518, 'f1-score': 0.8993684646443731, 'support': 9868.0} | {'precision': 0.8780578758949881, 'recall': 0.90290666462152, 'f1-score': 0.890308919726245, 'support': 13039.0} | 0.8410 | {'precision': 0.7844296369772342, 'recall': 0.7852540434979722, 'f1-score': 0.7846660065252478, 'support': 29334.0} | {'precision': 0.8418489339002468, 'recall': 0.8410377036885526, 'f1-score': 0.841216512966489, 'support': 29334.0} |
108
- | 0.0062 | 36.0 | 2916 | 1.1666 | {'precision': 0.6117251321480057, 'recall': 0.5973721257625528, 'f1-score': 0.6044634377967711, 'support': 4262.0} | {'precision': 0.7328311918475853, 'recall': 0.763972286374134, 'f1-score': 0.7480777928539123, 'support': 2165.0} | {'precision': 0.9175440425310122, 'recall': 0.8919740575597892, 'f1-score': 0.9045783875443194, 'support': 9868.0} | {'precision': 0.8791472751839063, 'recall': 0.8982283917478334, 'f1-score': 0.8885854102651645, 'support': 13039.0} | 0.8425 | {'precision': 0.7853119104276274, 'recall': 0.7878867153610773, 'f1-score': 0.7864262571150419, 'support': 29334.0} | {'precision': 0.8424107853134181, 'recall': 0.842503579464103, 'f1-score': 0.8423145935144672, 'support': 29334.0} |
109
- | 0.0062 | 37.0 | 2997 | 1.2146 | {'precision': 0.6104142011834319, 'recall': 0.6051149694978883, 'f1-score': 0.6077530340520797, 'support': 4262.0} | {'precision': 0.8113879003558719, 'recall': 0.7371824480369515, 'f1-score': 0.7725072604065828, 'support': 2165.0} | {'precision': 0.9233368532206969, 'recall': 0.8860964734495338, 'f1-score': 0.9043334367566449, 'support': 9868.0} | {'precision': 0.8682709186658865, 'recall': 0.9104225784185904, 'f1-score': 0.888847291378084, 'support': 13039.0} | 0.8451 | {'precision': 0.8033524683564718, 'recall': 0.7847041173507411, 'f1-score': 0.7933602556483479, 'support': 29334.0} | {'precision': 0.845132361961566, 'recall': 0.845094429672053, 'f1-score': 0.8446295710132824, 'support': 29334.0} |
110
- | 0.0043 | 38.0 | 3078 | 1.2219 | {'precision': 0.607548995886765, 'recall': 0.5891600187705303, 'f1-score': 0.5982132221560452, 'support': 4262.0} | {'precision': 0.8046558704453441, 'recall': 0.7344110854503464, 'f1-score': 0.7679304515817436, 'support': 2165.0} | {'precision': 0.9161189358372457, 'recall': 0.8898459667612485, 'f1-score': 0.902791343237547, 'support': 9868.0} | {'precision': 0.8706011730205279, 'recall': 0.9107293504103076, 'f1-score': 0.8902132763596836, 'support': 13039.0} | 0.8440 | {'precision': 0.7997312437974707, 'recall': 0.7810366053481081, 'f1-score': 0.7897870733337549, 'support': 29334.0} | {'precision': 0.842826894860577, 'recall': 0.8439694552396536, 'f1-score': 0.8429941387477182, 'support': 29334.0} |
111
- | 0.0043 | 39.0 | 3159 | 1.2388 | {'precision': 0.5807318585900352, 'recall': 0.6590802440168935, 'f1-score': 0.6174304868666887, 'support': 4262.0} | {'precision': 0.8076535750251762, 'recall': 0.7408775981524249, 'f1-score': 0.7728258251023848, 'support': 2165.0} | {'precision': 0.9215976331360947, 'recall': 0.8838670449939198, 'f1-score': 0.9023380922822264, 'support': 9868.0} | {'precision': 0.8848011037020005, 'recall': 0.8853439680957128, 'f1-score': 0.8850724526565974, 'support': 13039.0} | 0.8413 | {'precision': 0.7986960426133265, 'recall': 0.7922922138147377, 'f1-score': 0.7944167142269745, 'support': 29334.0} | {'precision': 0.8473067500578716, 'recall': 0.8413104247630736, 'f1-score': 0.8437099833368404, 'support': 29334.0} |
112
- | 0.0043 | 40.0 | 3240 | 1.2564 | {'precision': 0.6038774533269506, 'recall': 0.5919755983106523, 'f1-score': 0.597867298578199, 'support': 4262.0} | {'precision': 0.8135162601626016, 'recall': 0.7394919168591224, 'f1-score': 0.7747398983789014, 'support': 2165.0} | {'precision': 0.9209081309398099, 'recall': 0.8837657073368463, 'f1-score': 0.9019547005895129, 'support': 9868.0} | {'precision': 0.8650677941390873, 'recall': 0.9101158064268732, 'f1-score': 0.8870202190081099, 'support': 13039.0} | 0.8424 | {'precision': 0.8008424096421124, 'recall': 0.7813372572333735, 'f1-score': 0.7903955291386808, 'support': 29334.0} | {'precision': 0.8420988891124668, 'recall': 0.8424353991954728, 'f1-score': 0.8417456851297015, 'support': 29334.0} |
113
- | 0.0043 | 41.0 | 3321 | 1.2344 | {'precision': 0.6037467393881907, 'recall': 0.5973721257625528, 'f1-score': 0.6005425168062271, 'support': 4262.0} | {'precision': 0.8185071574642127, 'recall': 0.7394919168591224, 'f1-score': 0.7769958747876727, 'support': 2165.0} | {'precision': 0.9191644908616188, 'recall': 0.8918727199027159, 'f1-score': 0.9053129661060536, 'support': 9868.0} | {'precision': 0.8714853525688209, 'recall': 0.9080450954827824, 'f1-score': 0.8893896713615024, 'support': 13039.0} | 0.8450 | {'precision': 0.8032259350707107, 'recall': 0.7841954645017934, 'f1-score': 0.793060257265364, 'support': 29334.0} | {'precision': 0.8447143010550829, 'recall': 0.8450262494034226, 'f1-score': 0.8444838259344317, 'support': 29334.0} |
114
- | 0.0043 | 42.0 | 3402 | 1.2454 | {'precision': 0.607732085693179, 'recall': 0.5790708587517598, 'f1-score': 0.5930553886819657, 'support': 4262.0} | {'precision': 0.8161802355350742, 'recall': 0.7362586605080832, 'f1-score': 0.7741622146673143, 'support': 2165.0} | {'precision': 0.9137449581135588, 'recall': 0.8953182002432104, 'f1-score': 0.9044377335312486, 'support': 9868.0} | {'precision': 0.869606622225478, 'recall': 0.9104225784185904, 'f1-score': 0.8895466466841514, 'support': 13039.0} | 0.8443 | {'precision': 0.8018159753918225, 'recall': 0.780267574480411, 'f1-score': 0.79030049589117, 'support': 29334.0} | {'precision': 0.8424633651401231, 'recall': 0.8443444467171201, 'f1-score': 0.8429622125151117, 'support': 29334.0} |
115
- | 0.0043 | 43.0 | 3483 | 1.2396 | {'precision': 0.5977417078334509, 'recall': 0.5961989676208352, 'f1-score': 0.5969693410078702, 'support': 4262.0} | {'precision': 0.8070805541303232, 'recall': 0.7265588914549653, 'f1-score': 0.764705882352941, 'support': 2165.0} | {'precision': 0.9202486304256215, 'recall': 0.8851844345358735, 'f1-score': 0.9023760330578511, 'support': 9868.0} | {'precision': 0.8693739920832723, 'recall': 0.9095789554413682, 'f1-score': 0.8890221505940558, 'support': 13039.0} | 0.8423 | {'precision': 0.798611221118167, 'recall': 0.7793803122632605, 'f1-score': 0.7882683517531794, 'support': 29334.0} | {'precision': 0.8424246787445332, 'recall': 0.8423331287925274, 'f1-score': 0.8419062549424022, 'support': 29334.0} |
116
- | 0.0034 | 44.0 | 3564 | 1.2523 | {'precision': 0.6167139540882125, 'recall': 0.5610042233693102, 'f1-score': 0.5875414670106893, 'support': 4262.0} | {'precision': 0.8153061224489796, 'recall': 0.7381062355658199, 'f1-score': 0.7747878787878788, 'support': 2165.0} | {'precision': 0.9169854233433268, 'recall': 0.8988650182407782, 'f1-score': 0.9078348088634154, 'support': 9868.0} | {'precision': 0.8653067129629629, 'recall': 0.9174016412301557, 'f1-score': 0.8905930089714477, 'support': 13039.0} | 0.8462 | {'precision': 0.8035780532108705, 'recall': 0.7788442796015159, 'f1-score': 0.7901892909083578, 'support': 29334.0} | {'precision': 0.8428826281892011, 'recall': 0.8461512238358219, 'f1-score': 0.8438151506040159, 'support': 29334.0} |
117
- | 0.0034 | 45.0 | 3645 | 1.2569 | {'precision': 0.5956501403180543, 'recall': 0.5976067573908963, 'f1-score': 0.5966268446943078, 'support': 4262.0} | {'precision': 0.8109375, 'recall': 0.7191685912240184, 'f1-score': 0.7623011015911872, 'support': 2165.0} | {'precision': 0.9264893617021277, 'recall': 0.882549655451966, 'f1-score': 0.9039858833298734, 'support': 9868.0} | {'precision': 0.8643907410103363, 'recall': 0.9107293504103076, 'f1-score': 0.8869552227658065, 'support': 13039.0} | 0.8416 | {'precision': 0.7993669357576295, 'recall': 0.777513588619297, 'f1-score': 0.7874672630952938, 'support': 29334.0} | {'precision': 0.8422897824656003, 'recall': 0.8416172359719097, 'f1-score': 0.8413018116647781, 'support': 29334.0} |
118
- | 0.0034 | 46.0 | 3726 | 1.2538 | {'precision': 0.5921505623135185, 'recall': 0.6053496011262318, 'f1-score': 0.5986773407587886, 'support': 4262.0} | {'precision': 0.8124022928608651, 'recall': 0.7200923787528868, 'f1-score': 0.7634671890303624, 'support': 2165.0} | {'precision': 0.9249020230907743, 'recall': 0.8848804215646534, 'f1-score': 0.9044487026775078, 'support': 9868.0} | {'precision': 0.8677388558419622, 'recall': 0.9062044635324795, 'f1-score': 0.8865546218487395, 'support': 13039.0} | 0.8416 | {'precision': 0.79929843352678, 'recall': 0.779131716244063, 'f1-score': 0.7882869635788495, 'support': 29334.0} | {'precision': 0.8428436887504975, 'recall': 0.8415831458375946, 'f1-score': 0.8416634213837886, 'support': 29334.0} |
119
- | 0.0034 | 47.0 | 3807 | 1.2729 | {'precision': 0.5972959922742637, 'recall': 0.5804786485218207, 'f1-score': 0.5887672536887196, 'support': 4262.0} | {'precision': 0.8081907724209435, 'recall': 0.7200923787528868, 'f1-score': 0.7616023448949681, 'support': 2165.0} | {'precision': 0.9219409282700421, 'recall': 0.8856911228212404, 'f1-score': 0.9034525532354765, 'support': 9868.0} | {'precision': 0.8636000870637742, 'recall': 0.9128767543523276, 'f1-score': 0.8875549921706063, 'support': 13039.0} | 0.8412 | {'precision': 0.7977569450072559, 'recall': 0.7747847261120688, 'f1-score': 0.7853442859974425, 'support': 29334.0} | {'precision': 0.8404446429657594, 'recall': 0.8412081543601282, 'f1-score': 0.8401954881761488, 'support': 29334.0} |
120
- | 0.0034 | 48.0 | 3888 | 1.2605 | {'precision': 0.5967088003815884, 'recall': 0.5870483341154388, 'f1-score': 0.5918391484328799, 'support': 4262.0} | {'precision': 0.8079877112135176, 'recall': 0.7288683602771363, 'f1-score': 0.7663914521612433, 'support': 2165.0} | {'precision': 0.9202300052273915, 'recall': 0.8919740575597892, 'f1-score': 0.9058817475428395, 'support': 9868.0} | {'precision': 0.8690449974308155, 'recall': 0.9079684024848531, 'f1-score': 0.8880804140724626, 'support': 13039.0} | 0.8427 | {'precision': 0.7984928785633282, 'recall': 0.7789647886093043, 'f1-score': 0.7880481905523563, 'support': 29334.0} | {'precision': 0.8421890541722198, 'recall': 0.842742210404309, 'f1-score': 0.8420460062860028, 'support': 29334.0} |
121
- | 0.0034 | 49.0 | 3969 | 1.2654 | {'precision': 0.5976983936705826, 'recall': 0.5849366494603473, 'f1-score': 0.5912486659551762, 'support': 4262.0} | {'precision': 0.8090117767537123, 'recall': 0.7297921478060047, 'f1-score': 0.7673627974745022, 'support': 2165.0} | {'precision': 0.9196736743018513, 'recall': 0.8910620186461289, 'f1-score': 0.9051417983426837, 'support': 9868.0} | {'precision': 0.8682687376364568, 'recall': 0.9088887184600046, 'f1-score': 0.8881145083932854, 'support': 13039.0} | 0.8426 | {'precision': 0.7986631455906508, 'recall': 0.7786698835931214, 'f1-score': 0.787966942541412, 'support': 29334.0} | {'precision': 0.841876216627403, 'recall': 0.8426058498670485, 'f1-score': 0.8417981390815746, 'support': 29334.0} |
122
- | 0.0031 | 50.0 | 4050 | 1.2704 | {'precision': 0.5972354623450906, 'recall': 0.5879868606288128, 'f1-score': 0.5925750768503193, 'support': 4262.0} | {'precision': 0.8091328886608518, 'recall': 0.7284064665127021, 'f1-score': 0.7666504618376278, 'support': 2165.0} | {'precision': 0.9211161229413616, 'recall': 0.8898459667612485, 'f1-score': 0.9052110715942477, 'support': 9868.0} | {'precision': 0.8676039835969537, 'recall': 0.9086586394662167, 'f1-score': 0.8876568645813823, 'support': 13039.0} | 0.8424 | {'precision': 0.7987721143860643, 'recall': 0.7787244833422451, 'f1-score': 0.7880233687158943, 'support': 29334.0} | {'precision': 0.8420076528182845, 'recall': 0.8424353991954728, 'f1-score': 0.8417581625139158, 'support': 29334.0} |
123
 
124
 
125
  ### Framework versions
 
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
+ split: train[20%:40%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
+ value: 0.8596357867600886
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 1.0920
36
+ - Claim: {'precision': 0.6182355616189177, 'recall': 0.6244832338079926, 'f1-score': 0.6213436928702011, 'support': 4354.0}
37
+ - Majorclaim: {'precision': 0.8, 'recall': 0.86504895700298, 'f1-score': 0.8312538351401105, 'support': 2349.0}
38
+ - O: {'precision': 0.9246820349761526, 'recall': 0.9141453831041257, 'f1-score': 0.919383521043272, 'support': 10180.0}
39
+ - Premise: {'precision': 0.9017729158807997, 'recall': 0.8937490653506804, 'f1-score': 0.8977430620751813, 'support': 13374.0}
40
+ - Accuracy: 0.8596
41
+ - Macro avg: {'precision': 0.8111726281189675, 'recall': 0.8243566598164448, 'f1-score': 0.8174310277821912, 'support': 30257.0}
42
+ - Weighted avg: {'precision': 0.8607783894085936, 'recall': 0.8596357867600886, 'f1-score': 0.8600881004037069, 'support': 30257.0}
43
 
44
  ## Model description
45
 
 
68
 
69
  ### Training results
70
 
71
+ | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
+ |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
+ | No log | 1.0 | 81 | 0.4783 | {'precision': 0.5477537437603993, 'recall': 0.3780431786862655, 'f1-score': 0.44734338904742493, 'support': 4354.0} | {'precision': 0.5898856944925528, 'recall': 0.7249893571732652, 'f1-score': 0.6504965622612681, 'support': 2349.0} | {'precision': 0.8689081979599547, 'recall': 0.9037328094302554, 'f1-score': 0.8859784283513097, 'support': 10180.0} | {'precision': 0.859258183929738, 'recall': 0.8851502916105877, 'f1-score': 0.8720120805863504, 'support': 13374.0} | 0.8060 | {'precision': 0.7164514550356611, 'recall': 0.7229789092250934, 'f1-score': 0.7139576150615883, 'support': 30257.0} | {'precision': 0.7967665566250599, 'recall': 0.8059953068711373, 'f1-score': 0.7984036588902531, 'support': 30257.0} |
74
+ | No log | 2.0 | 162 | 0.4242 | {'precision': 0.5281409891984082, 'recall': 0.6401010564997703, 'f1-score': 0.5787561000934482, 'support': 4354.0} | {'precision': 0.7017850892544627, 'recall': 0.8535547041294168, 'f1-score': 0.7702650787552824, 'support': 2349.0} | {'precision': 0.9206077681626081, 'recall': 0.8987229862475442, 'f1-score': 0.9095337508698677, 'support': 10180.0} | {'precision': 0.9162905211325401, 'recall': 0.8348287722446538, 'f1-score': 0.8736648538675224, 'support': 13374.0} | 0.8298 | {'precision': 0.7667060919370048, 'recall': 0.8068018797803463, 'f1-score': 0.7830549458965301, 'support': 30257.0} | {'precision': 0.8452350051608073, 'recall': 0.8297584030141786, 'f1-score': 0.8352680063880269, 'support': 30257.0} |
75
+ | No log | 3.0 | 243 | 0.4107 | {'precision': 0.5899245558530056, 'recall': 0.5567294441892513, 'f1-score': 0.5728465083303793, 'support': 4354.0} | {'precision': 0.8017699115044248, 'recall': 0.7713920817369093, 'f1-score': 0.7862876979822088, 'support': 2349.0} | {'precision': 0.9048168445341794, 'recall': 0.9244597249508841, 'f1-score': 0.914532821534425, 'support': 10180.0} | {'precision': 0.8843330614665975, 'recall': 0.8918049947659639, 'f1-score': 0.8880533114924986, 'support': 13374.0} | 0.8452 | {'precision': 0.7952110933395518, 'recall': 0.7860965614107521, 'f1-score': 0.7904300848348779, 'support': 30257.0} | {'precision': 0.8424495118392472, 'recall': 0.8452258981392735, 'f1-score': 0.8437033615676307, 'support': 30257.0} |
76
+ | No log | 4.0 | 324 | 0.4546 | {'precision': 0.5714596949891068, 'recall': 0.6024345429490124, 'f1-score': 0.5865384615384616, 'support': 4354.0} | {'precision': 0.7425589485890993, 'recall': 0.8177948063005535, 'f1-score': 0.7783630470016208, 'support': 2349.0} | {'precision': 0.9063411787589963, 'recall': 0.9154223968565816, 'f1-score': 0.9108591535529275, 'support': 10180.0} | {'precision': 0.9067823097358962, 'recall': 0.8677284282937042, 'f1-score': 0.8868256151612411, 'support': 13374.0} | 0.8417 | {'precision': 0.7817855330182747, 'recall': 0.8008450435999629, 'f1-score': 0.7906465693135627, 'support': 30257.0} | {'precision': 0.8456313015960876, 'recall': 0.8417225765938461, 'f1-score': 0.8432797441676475, 'support': 30257.0} |
77
+ | No log | 5.0 | 405 | 0.4870 | {'precision': 0.5985704403965875, 'recall': 0.5962333486449242, 'f1-score': 0.597399608790703, 'support': 4354.0} | {'precision': 0.7940298507462686, 'recall': 0.7926777352064709, 'f1-score': 0.7933532168726033, 'support': 2349.0} | {'precision': 0.9042862684251358, 'recall': 0.9160117878192534, 'f1-score': 0.9101112629318758, 'support': 10180.0} | {'precision': 0.8961019377214808, 'recall': 0.8886645730521908, 'f1-score': 0.8923677591320345, 'support': 13374.0} | 0.8483 | {'precision': 0.7982471243223681, 'recall': 0.7983968611807098, 'f1-score': 0.7983079619318041, 'support': 30257.0} | {'precision': 0.8481162489521332, 'recall': 0.848332617245596, 'f1-score': 0.8482045037639816, 'support': 30257.0} |
78
+ | No log | 6.0 | 486 | 0.5424 | {'precision': 0.5903745644599303, 'recall': 0.6226458429030777, 'f1-score': 0.6060809300245921, 'support': 4354.0} | {'precision': 0.7963286713286714, 'recall': 0.7756492124308216, 'f1-score': 0.7858529221479404, 'support': 2349.0} | {'precision': 0.9398504051527115, 'recall': 0.8887033398821218, 'f1-score': 0.9135615470059578, 'support': 10180.0} | {'precision': 0.88328121591157, 'recall': 0.908180050844923, 'f1-score': 0.895557603686636, 'support': 13374.0} | 0.8502 | {'precision': 0.8024587142132208, 'recall': 0.7987946115152361, 'f1-score': 0.8002632507162816, 'support': 30257.0} | {'precision': 0.8534139871324166, 'recall': 0.8502495290346036, 'f1-score': 0.8514422719925407, 'support': 30257.0} |
79
+ | 0.35 | 7.0 | 567 | 0.5764 | {'precision': 0.6054453161052146, 'recall': 0.6026642168121268, 'f1-score': 0.6040515653775324, 'support': 4354.0} | {'precision': 0.8051063829787234, 'recall': 0.8054491272882077, 'f1-score': 0.8052777186635455, 'support': 2349.0} | {'precision': 0.9315082331548641, 'recall': 0.9057956777996071, 'f1-score': 0.9184720354599332, 'support': 10180.0} | {'precision': 0.8810881965774463, 'recall': 0.9008524001794527, 'f1-score': 0.8908606921029282, 'support': 13374.0} | 0.8522 | {'precision': 0.8057870322040621, 'recall': 0.8036903555198486, 'f1-score': 0.8046655029009848, 'support': 30257.0} | {'precision': 0.8524880574571969, 'recall': 0.8521994910268698, 'f1-score': 0.8522343290465387, 'support': 30257.0} |
80
+ | 0.35 | 8.0 | 648 | 0.5955 | {'precision': 0.6227261400448543, 'recall': 0.5739549839228296, 'f1-score': 0.597346719254213, 'support': 4354.0} | {'precision': 0.7676845767298028, 'recall': 0.8454661558109834, 'f1-score': 0.8047001620745543, 'support': 2349.0} | {'precision': 0.9258769700050838, 'recall': 0.8944990176817289, 'f1-score': 0.9099175618286286, 'support': 10180.0} | {'precision': 0.8797569092750688, 'recall': 0.9092268580828473, 'f1-score': 0.8942491542873952, 'support': 13374.0} | 0.8511 | {'precision': 0.7990111490137024, 'recall': 0.8057867538745973, 'f1-score': 0.8015533993611977, 'support': 30257.0} | {'precision': 0.8495864475589161, 'recall': 0.8510757841160723, 'f1-score': 0.8498442431569896, 'support': 30257.0} |
81
+ | 0.35 | 9.0 | 729 | 0.5690 | {'precision': 0.6213075060532688, 'recall': 0.5893431327514929, 'f1-score': 0.6049033474776048, 'support': 4354.0} | {'precision': 0.8628731343283582, 'recall': 0.787569178373776, 'f1-score': 0.823503227242377, 'support': 2349.0} | {'precision': 0.9027672479150872, 'recall': 0.9357563850687622, 'f1-score': 0.9189658498938837, 'support': 10180.0} | {'precision': 0.8970292606656243, 'recall': 0.9008524001794527, 'f1-score': 0.8989367655288193, 'support': 13374.0} | 0.8590 | {'precision': 0.8209942872405847, 'recall': 0.803380274093371, 'f1-score': 0.8115772975356712, 'support': 30257.0} | {'precision': 0.8566315824374819, 'recall': 0.8589747826949136, 'f1-score': 0.8575077142417292, 'support': 30257.0} |
82
+ | 0.35 | 10.0 | 810 | 0.7088 | {'precision': 0.6071094480823199, 'recall': 0.5962333486449242, 'f1-score': 0.60162224797219, 'support': 4354.0} | {'precision': 0.8333333333333334, 'recall': 0.7939548744146445, 'f1-score': 0.8131676477000218, 'support': 2349.0} | {'precision': 0.9338801134062373, 'recall': 0.905992141453831, 'f1-score': 0.9197247706422018, 'support': 10180.0} | {'precision': 0.884834499170693, 'recall': 0.9174517720951099, 'f1-score': 0.9008479864909512, 'support': 13374.0} | 0.8578 | {'precision': 0.8147893484981459, 'recall': 0.8034080341521274, 'f1-score': 0.8088406632013413, 'support': 30257.0} | {'precision': 0.8573728619273148, 'recall': 0.8577849753775986, 'f1-score': 0.8573332851434664, 'support': 30257.0} |
83
+ | 0.35 | 11.0 | 891 | 0.7312 | {'precision': 0.6289498141263941, 'recall': 0.6217271474506201, 'f1-score': 0.6253176253176252, 'support': 4354.0} | {'precision': 0.7318996415770609, 'recall': 0.8693060876968923, 'f1-score': 0.7947071414672116, 'support': 2349.0} | {'precision': 0.9221171261823304, 'recall': 0.900196463654224, 'f1-score': 0.9110249527786062, 'support': 10180.0} | {'precision': 0.9047258979206049, 'recall': 0.8946463286974727, 'f1-score': 0.8996578818752584, 'support': 13374.0} | 0.8553 | {'precision': 0.7969231199515976, 'recall': 0.8214690068748023, 'f1-score': 0.8076769003596753, 'support': 30257.0} | {'precision': 0.857475501606145, 'recall': 0.8552731599299336, 'f1-score': 0.8558567785115953, 'support': 30257.0} |
84
+ | 0.35 | 12.0 | 972 | 0.7092 | {'precision': 0.6395321637426901, 'recall': 0.6279283417547084, 'f1-score': 0.633677135241627, 'support': 4354.0} | {'precision': 0.7931570762052877, 'recall': 0.8684546615581098, 'f1-score': 0.8290997764681975, 'support': 2349.0} | {'precision': 0.9196243203163619, 'recall': 0.9137524557956778, 'f1-score': 0.916678984971668, 'support': 10180.0} | {'precision': 0.905603610379842, 'recall': 0.9002542246149244, 'f1-score': 0.9029209944129889, 'support': 13374.0} | 0.8631 | {'precision': 0.8144792926610454, 'recall': 0.8275974209308551, 'f1-score': 0.8205942227736204, 'support': 30257.0} | {'precision': 0.8633032778855295, 'recall': 0.8631391083055161, 'f1-score': 0.8630744313070275, 'support': 30257.0} |
85
+ | 0.063 | 13.0 | 1053 | 0.7807 | {'precision': 0.6096321393998064, 'recall': 0.5785484611851172, 'f1-score': 0.5936837143530521, 'support': 4354.0} | {'precision': 0.821270962047661, 'recall': 0.7922520221370796, 'f1-score': 0.8065005417118094, 'support': 2349.0} | {'precision': 0.9242683294780247, 'recall': 0.9027504911591355, 'f1-score': 0.9133826964170352, 'support': 10180.0} | {'precision': 0.883730957171601, 'recall': 0.9195453865709585, 'f1-score': 0.901282521069989, 'support': 13374.0} | 0.8549 | {'precision': 0.8097255970242733, 'recall': 0.7982740902630727, 'f1-score': 0.8037123683879714, 'support': 30257.0} | {'precision': 0.8530777420132861, 'recall': 0.854942657897346, 'f1-score': 0.8537315976828396, 'support': 30257.0} |
86
+ | 0.063 | 14.0 | 1134 | 0.7879 | {'precision': 0.632554945054945, 'recall': 0.6345888837850253, 'f1-score': 0.6335702820454024, 'support': 4354.0} | {'precision': 0.816793893129771, 'recall': 0.8199233716475096, 'f1-score': 0.8183556405353729, 'support': 2349.0} | {'precision': 0.9107990314769976, 'recall': 0.9237721021611002, 'f1-score': 0.9172396976347231, 'support': 10180.0} | {'precision': 0.9039073148568832, 'recall': 0.8925527142216241, 'f1-score': 0.8981941309255079, 'support': 13374.0} | 0.8603 | {'precision': 0.8160137961296492, 'recall': 0.8177092679538147, 'f1-score': 0.8168399377852517, 'support': 30257.0} | {'precision': 0.8604152313535001, 'recall': 0.8602967908252636, 'f1-score': 0.8603242501425289, 'support': 30257.0} |
87
+ | 0.063 | 15.0 | 1215 | 0.8185 | {'precision': 0.5828134433487623, 'recall': 0.6651355075792375, 'f1-score': 0.6212592513139547, 'support': 4354.0} | {'precision': 0.7765273311897106, 'recall': 0.822477650063857, 'f1-score': 0.7988422575976845, 'support': 2349.0} | {'precision': 0.9276255938542404, 'recall': 0.9014734774066797, 'f1-score': 0.9143625765954267, 'support': 10180.0} | {'precision': 0.9090416053304409, 'recall': 0.8772992373261552, 'f1-score': 0.8928883984627678, 'support': 13374.0} | 0.8506 | {'precision': 0.7990019934307886, 'recall': 0.8165964680939823, 'f1-score': 0.8068381209924584, 'support': 30257.0} | {'precision': 0.8580620487302317, 'recall': 0.8506461314737086, 'f1-score': 0.8537245501570023, 'support': 30257.0} |
88
+ | 0.063 | 16.0 | 1296 | 0.8933 | {'precision': 0.5878725590955807, 'recall': 0.6568672485071199, 'f1-score': 0.620457750298297, 'support': 4354.0} | {'precision': 0.7911741528762806, 'recall': 0.8548318433375904, 'f1-score': 0.8217720482913852, 'support': 2349.0} | {'precision': 0.9427445285758739, 'recall': 0.8928290766208251, 'f1-score': 0.9171081176529942, 'support': 10180.0} | {'precision': 0.900703852266707, 'recall': 0.8898609241812472, 'f1-score': 0.8952495580546884, 'support': 13374.0} | 0.8546 | {'precision': 0.8056237732036106, 'recall': 0.8235972731616956, 'f1-score': 0.8136468685743412, 'support': 30257.0} | {'precision': 0.8613285464033407, 'recall': 0.8546121558647586, 'f1-score': 0.8573567707758909, 'support': 30257.0} |
89
+ | 0.063 | 17.0 | 1377 | 0.8753 | {'precision': 0.6926782273603083, 'recall': 0.49540652273771246, 'f1-score': 0.577664702731655, 'support': 4354.0} | {'precision': 0.7783269961977186, 'recall': 0.8714346530438485, 'f1-score': 0.8222534645511148, 'support': 2349.0} | {'precision': 0.9185462424899045, 'recall': 0.9161100196463654, 'f1-score': 0.9173265135494024, 'support': 10180.0} | {'precision': 0.8705431754874652, 'recall': 0.9347240915208613, 'f1-score': 0.901492752578063, 'support': 13374.0} | 0.8603 | {'precision': 0.8150236603838491, 'recall': 0.8044188217371968, 'f1-score': 0.8046843583525589, 'support': 30257.0} | {'precision': 0.8539397922302876, 'recall': 0.8603298410285223, 'f1-score': 0.8540692561997597, 'support': 30257.0} |
90
+ | 0.063 | 18.0 | 1458 | 0.9685 | {'precision': 0.5981667021956939, 'recall': 0.6444648598989435, 'f1-score': 0.6204532891100056, 'support': 4354.0} | {'precision': 0.807372175980975, 'recall': 0.8671775223499362, 'f1-score': 0.8362068965517241, 'support': 2349.0} | {'precision': 0.8936068244991853, 'recall': 0.9158153241650294, 'f1-score': 0.9045747829039926, 'support': 10180.0} | {'precision': 0.9118953211736717, 'recall': 0.8598026020637057, 'f1-score': 0.8850831280788178, 'support': 13374.0} | 0.8482 | {'precision': 0.8027602559623814, 'recall': 0.8218150771194037, 'f1-score': 0.811579524161135, 'support': 30257.0} | {'precision': 0.8524817583209754, 'recall': 0.8482334666358198, 'f1-score': 0.8497662248627994, 'support': 30257.0} |
91
+ | 0.0216 | 19.0 | 1539 | 0.9391 | {'precision': 0.5946462715105163, 'recall': 0.6428571428571429, 'f1-score': 0.6178126034654013, 'support': 4354.0} | {'precision': 0.7575868372943327, 'recall': 0.8820774797786292, 'f1-score': 0.8151062155782848, 'support': 2349.0} | {'precision': 0.9213595136051032, 'recall': 0.9080550098231827, 'f1-score': 0.9146588828971454, 'support': 10180.0} | {'precision': 0.9104991394148021, 'recall': 0.870195902497383, 'f1-score': 0.8898914207065302, 'support': 13374.0} | 0.8511 | {'precision': 0.7960229404561886, 'recall': 0.8257963837390844, 'f1-score': 0.8093672806618404, 'support': 30257.0} | {'precision': 0.8568303759789367, 'recall': 0.8511418845225898, 'f1-score': 0.853266214902463, 'support': 30257.0} |
92
+ | 0.0216 | 20.0 | 1620 | 0.8916 | {'precision': 0.6064530788457169, 'recall': 0.6129995406522738, 'f1-score': 0.6097087378640776, 'support': 4354.0} | {'precision': 0.7802114803625377, 'recall': 0.8795232013622818, 'f1-score': 0.8268961376826096, 'support': 2349.0} | {'precision': 0.9370494466443293, 'recall': 0.906581532416503, 'f1-score': 0.9215637325877477, 'support': 10180.0} | {'precision': 0.8971479901190209, 'recall': 0.8961417676087932, 'f1-score': 0.896644596566042, 'support': 13374.0} | 0.8576 | {'precision': 0.8052154989929012, 'recall': 0.8238115105099629, 'f1-score': 0.8137033011751192, 'support': 30257.0} | {'precision': 0.8596633525913644, 'recall': 0.8576197243613048, 'f1-score': 0.8583235120565212, 'support': 30257.0} |
93
+ | 0.0216 | 21.0 | 1701 | 0.9741 | {'precision': 0.5754014884449667, 'recall': 0.6747818098300413, 'f1-score': 0.6211416490486258, 'support': 4354.0} | {'precision': 0.7965964343598055, 'recall': 0.8369518944231588, 'f1-score': 0.8162756902636495, 'support': 2349.0} | {'precision': 0.9325935059597205, 'recall': 0.8915520628683693, 'f1-score': 0.911611088790679, 'support': 10180.0} | {'precision': 0.9030190718863408, 'recall': 0.8744579033946464, 'f1-score': 0.8885090218423553, 'support': 13374.0} | 0.8486 | {'precision': 0.8019026251627084, 'recall': 0.8194359176290539, 'f1-score': 0.8093843624863275, 'support': 30257.0} | {'precision': 0.8575629461968616, 'recall': 0.8485639686684073, 'f1-score': 0.852199586158436, 'support': 30257.0} |
94
+ | 0.0216 | 22.0 | 1782 | 0.9676 | {'precision': 0.6028274795670422, 'recall': 0.6267799724391364, 'f1-score': 0.6145704312577412, 'support': 4354.0} | {'precision': 0.784251968503937, 'recall': 0.8480204342273308, 'f1-score': 0.8148905706688483, 'support': 2349.0} | {'precision': 0.9137847053093034, 'recall': 0.9214145383104125, 'f1-score': 0.9175837613108339, 'support': 10180.0} | {'precision': 0.9070019342359767, 'recall': 0.876551517870495, 'f1-score': 0.8915167877105593, 'support': 13374.0} | 0.8535 | {'precision': 0.8019665219040648, 'recall': 0.8181916157118437, 'f1-score': 0.8096403877369956, 'support': 30257.0} | {'precision': 0.8559834381654265, 'recall': 0.853488448953961, 'f1-score': 0.8544854353433136, 'support': 30257.0} |
95
+ | 0.0216 | 23.0 | 1863 | 0.9898 | {'precision': 0.6113108075724898, 'recall': 0.5858980248047773, 'f1-score': 0.5983347015362965, 'support': 4354.0} | {'precision': 0.8553230209281165, 'recall': 0.800340570455513, 'f1-score': 0.8269188475918188, 'support': 2349.0} | {'precision': 0.9227514268844715, 'recall': 0.9211198428290767, 'f1-score': 0.9219349129879069, 'support': 10180.0} | {'precision': 0.8835616438356164, 'recall': 0.9066846119336025, 'f1-score': 0.8949737988043397, 'support': 13374.0} | 0.8571 | {'precision': 0.8182367248051736, 'recall': 0.8035107625057423, 'f1-score': 0.8105405652300904, 'support': 30257.0} | {'precision': 0.8553777302003576, 'recall': 0.8571239713124236, 'f1-score': 0.8560749136698399, 'support': 30257.0} |
96
+ | 0.0216 | 24.0 | 1944 | 0.9720 | {'precision': 0.6016132646202106, 'recall': 0.6166743224621039, 'f1-score': 0.6090506975161619, 'support': 4354.0} | {'precision': 0.7454477889260498, 'recall': 0.853980417198808, 'f1-score': 0.7960317460317461, 'support': 2349.0} | {'precision': 0.9310592091784471, 'recall': 0.8928290766208251, 'f1-score': 0.9115434760806339, 'support': 10180.0} | {'precision': 0.9006821077880219, 'recall': 0.89845969792134, 'f1-score': 0.8995695302264645, 'support': 13374.0} | 0.8526 | {'precision': 0.7947005926281823, 'recall': 0.8154858785507693, 'f1-score': 0.8040488624637516, 'support': 30257.0} | {'precision': 0.8558147294621835, 'recall': 0.852563043262716, 'f1-score': 0.8537541987693271, 'support': 30257.0} |
97
+ | 0.0116 | 25.0 | 2025 | 1.0132 | {'precision': 0.6326429980276134, 'recall': 0.5893431327514929, 'f1-score': 0.6102259215219976, 'support': 4354.0} | {'precision': 0.8006714225765842, 'recall': 0.8122605363984674, 'f1-score': 0.8064243448858834, 'support': 2349.0} | {'precision': 0.9298989898989899, 'recall': 0.9043222003929273, 'f1-score': 0.9169322709163347, 'support': 10180.0} | {'precision': 0.8818077309958328, 'recall': 0.917676087931808, 'f1-score': 0.8993844349992672, 'support': 13374.0} | 0.8578 | {'precision': 0.811255285374755, 'recall': 0.8059004893686739, 'f1-score': 0.8082417430808707, 'support': 30257.0} | {'precision': 0.8558341242209939, 'recall': 0.8577519251743398, 'f1-score': 0.8564613940592988, 'support': 30257.0} |
98
+ | 0.0116 | 26.0 | 2106 | 1.0290 | {'precision': 0.6006185111552905, 'recall': 0.6244832338079926, 'f1-score': 0.6123184326089406, 'support': 4354.0} | {'precision': 0.8013876843018214, 'recall': 0.7867177522349936, 'f1-score': 0.7939849624060151, 'support': 2349.0} | {'precision': 0.93204469948656, 'recall': 0.9094302554027505, 'f1-score': 0.9205986178093769, 'support': 10180.0} | {'precision': 0.8957082499444073, 'recall': 0.9035441902198296, 'f1-score': 0.8996091568955891, 'support': 13374.0} | 0.8563 | {'precision': 0.8074397862220198, 'recall': 0.8060438579163915, 'f1-score': 0.8066277924299805, 'support': 30257.0} | {'precision': 0.8581475309358099, 'recall': 0.8562977162309549, 'f1-score': 0.8571296534981037, 'support': 30257.0} |
99
+ | 0.0116 | 27.0 | 2187 | 1.0471 | {'precision': 0.6480063374702931, 'recall': 0.5636196600826826, 'f1-score': 0.6028743397617001, 'support': 4354.0} | {'precision': 0.8347863993025283, 'recall': 0.8152405278842061, 'f1-score': 0.8248976954555244, 'support': 2349.0} | {'precision': 0.9111240197502178, 'recall': 0.9244597249508841, 'f1-score': 0.9177434297137843, 'support': 10180.0} | {'precision': 0.883512674225464, 'recall': 0.9147599820547331, 'f1-score': 0.8988648469931302, 'support': 13374.0} | 0.8598 | {'precision': 0.8193573576871258, 'recall': 0.8045199737431264, 'f1-score': 0.8110950779810349, 'support': 30257.0} | {'precision': 0.8551301805022264, 'recall': 0.8597679875731236, 'f1-score': 0.8568809247486504, 'support': 30257.0} |
100
+ | 0.0116 | 28.0 | 2268 | 1.0588 | {'precision': 0.6152253909843606, 'recall': 0.6143775838309601, 'f1-score': 0.6148011951275568, 'support': 4354.0} | {'precision': 0.7258282623394186, 'recall': 0.9140059599829715, 'f1-score': 0.80912003014886, 'support': 2349.0} | {'precision': 0.9418216001671192, 'recall': 0.8857563850687623, 'f1-score': 0.9129290270324997, 'support': 10180.0} | {'precision': 0.8978844284966734, 'recall': 0.8980858381935098, 'f1-score': 0.897985122051512, 'support': 13374.0} | 0.8543 | {'precision': 0.7951899204968929, 'recall': 0.8280564417690509, 'f1-score': 0.8087088435901071, 'support': 30257.0} | {'precision': 0.8586347680535737, 'recall': 0.8543477542386886, 'f1-score': 0.8553636471531488, 'support': 30257.0} |
101
+ | 0.0116 | 29.0 | 2349 | 1.0133 | {'precision': 0.6220508166969148, 'recall': 0.6297657326596233, 'f1-score': 0.6258845012554212, 'support': 4354.0} | {'precision': 0.7991071428571429, 'recall': 0.8382290336313325, 'f1-score': 0.8182007064201122, 'support': 2349.0} | {'precision': 0.9275189167662286, 'recall': 0.9151277013752456, 'f1-score': 0.9212816455696202, 'support': 10180.0} | {'precision': 0.8988831421932388, 'recall': 0.8966651712277554, 'f1-score': 0.8977727868238817, 'support': 13374.0} | 0.8599 | {'precision': 0.8118900046283812, 'recall': 0.8199469097234893, 'f1-score': 0.8157849100172588, 'support': 30257.0} | {'precision': 0.8609352431120858, 'recall': 0.8599332385894173, 'f1-score': 0.860379911449525, 'support': 30257.0} |
102
+ | 0.0116 | 30.0 | 2430 | 1.0924 | {'precision': 0.5691448382126348, 'recall': 0.6786862655029857, 'f1-score': 0.6191074795725958, 'support': 4354.0} | {'precision': 0.7735177865612648, 'recall': 0.8331204767986378, 'f1-score': 0.802213568354171, 'support': 2349.0} | {'precision': 0.9313517338995047, 'recall': 0.9049115913555992, 'f1-score': 0.9179413083553385, 'support': 10180.0} | {'precision': 0.9156912369503322, 'recall': 0.8657095857634216, 'f1-score': 0.8899992313014068, 'support': 13374.0} | 0.8495 | {'precision': 0.797426398905934, 'recall': 0.8206069798551611, 'f1-score': 0.8073153968958781, 'support': 30257.0} | {'precision': 0.8600543728816776, 'recall': 0.8494563241563936, 'f1-score': 0.853603657884304, 'support': 30257.0} |
103
+ | 0.0059 | 31.0 | 2511 | 1.0502 | {'precision': 0.5720296533760769, 'recall': 0.655718879191548, 'f1-score': 0.6110219368646335, 'support': 4354.0} | {'precision': 0.7757296466973886, 'recall': 0.8599404001702853, 'f1-score': 0.8156672723601858, 'support': 2349.0} | {'precision': 0.9318525996971226, 'recall': 0.906679764243615, 'f1-score': 0.9190938511326862, 'support': 10180.0} | {'precision': 0.9120482872148624, 'recall': 0.8699715866606849, 'f1-score': 0.890513183575064, 'support': 13374.0} | 0.8507 | {'precision': 0.7979150467463627, 'recall': 0.8230776575665333, 'f1-score': 0.8090740609831424, 'support': 30257.0} | {'precision': 0.8591995012400396, 'recall': 0.850712231880226, 'f1-score': 0.8540995689442556, 'support': 30257.0} |
104
+ | 0.0059 | 32.0 | 2592 | 1.0192 | {'precision': 0.6272174353775976, 'recall': 0.5684428112080845, 'f1-score': 0.5963855421686747, 'support': 4354.0} | {'precision': 0.8004073319755601, 'recall': 0.8365261813537676, 'f1-score': 0.8180682764363031, 'support': 2349.0} | {'precision': 0.9323861346231358, 'recall': 0.9089390962671906, 'f1-score': 0.9205133306804616, 'support': 10180.0} | {'precision': 0.8845822566752799, 'recall': 0.9214894571556752, 'f1-score': 0.9026587563172929, 'support': 13374.0} | 0.8599 | {'precision': 0.8111482896628934, 'recall': 0.8088493864961794, 'f1-score': 0.8094064764006831, 'support': 30257.0} | {'precision': 0.8570960600087044, 'recall': 0.8598671381828998, 'f1-score': 0.8580258765001771, 'support': 30257.0} |
105
+ | 0.0059 | 33.0 | 2673 | 1.0604 | {'precision': 0.618805002315887, 'recall': 0.6136885622416169, 'f1-score': 0.6162361623616236, 'support': 4354.0} | {'precision': 0.8121931260229133, 'recall': 0.8450404427415922, 'f1-score': 0.8282912580847068, 'support': 2349.0} | {'precision': 0.9235939507759218, 'recall': 0.9178781925343812, 'f1-score': 0.9207272010641968, 'support': 10180.0} | {'precision': 0.8986395574824338, 'recall': 0.8989083295947361, 'f1-score': 0.8987739234449761, 'support': 13374.0} | 0.8601 | {'precision': 0.813307909149289, 'recall': 0.8188788817780815, 'f1-score': 0.8160071362388759, 'support': 30257.0} | {'precision': 0.8600558711630416, 'recall': 0.8600654394024523, 'f1-score': 0.8600308614585094, 'support': 30257.0} |
106
+ | 0.0059 | 34.0 | 2754 | 1.0024 | {'precision': 0.5991000642811227, 'recall': 0.6421681212677998, 'f1-score': 0.6198869304955105, 'support': 4354.0} | {'precision': 0.7872755659640905, 'recall': 0.8586632609621115, 'f1-score': 0.8214212991244145, 'support': 2349.0} | {'precision': 0.9350253807106599, 'recall': 0.9047151277013753, 'f1-score': 0.9196205691462807, 'support': 10180.0} | {'precision': 0.9040825618455001, 'recall': 0.8908329594736055, 'f1-score': 0.897408858089786, 'support': 13374.0} | 0.8572 | {'precision': 0.8063708932003434, 'recall': 0.8240948673512231, 'f1-score': 0.8145844142139979, 'support': 30257.0} | {'precision': 0.8615378438736785, 'recall': 0.8572231219221998, 'f1-score': 0.8590471556672056, 'support': 30257.0} |
107
+ | 0.0059 | 35.0 | 2835 | 1.0053 | {'precision': 0.6278301886792453, 'recall': 0.6113918236104732, 'f1-score': 0.6195019781242729, 'support': 4354.0} | {'precision': 0.8007920792079208, 'recall': 0.8607918263090677, 'f1-score': 0.8297086581862947, 'support': 2349.0} | {'precision': 0.9243473101265823, 'recall': 0.9181728880157171, 'f1-score': 0.9212497535974769, 'support': 10180.0} | {'precision': 0.8998505231689088, 'recall': 0.9002542246149244, 'f1-score': 0.9000523286237572, 'support': 13374.0} | 0.8617 | {'precision': 0.8132050252956643, 'recall': 0.8226526906375455, 'f1-score': 0.8176281796329504, 'support': 30257.0} | {'precision': 0.8612582129595939, 'recall': 0.8616518491588723, 'f1-score': 0.8613517396129535, 'support': 30257.0} |
108
+ | 0.0059 | 36.0 | 2916 | 1.0221 | {'precision': 0.6272617611580217, 'recall': 0.5971520440973818, 'f1-score': 0.6118366866690199, 'support': 4354.0} | {'precision': 0.8109656301145662, 'recall': 0.8437633035334184, 'f1-score': 0.8270394325057375, 'support': 2349.0} | {'precision': 0.9288135593220339, 'recall': 0.9151277013752456, 'f1-score': 0.9219198416625434, 'support': 10180.0} | {'precision': 0.8907464437600822, 'recall': 0.908329594736055, 'f1-score': 0.8994520953650229, 'support': 13374.0} | 0.8608 | {'precision': 0.814446848588676, 'recall': 0.8160931609355251, 'f1-score': 0.8150620140505809, 'support': 30257.0} | {'precision': 0.8594447878496476, 'recall': 0.8608255940774036, 'f1-score': 0.8600016152377763, 'support': 30257.0} |
109
+ | 0.0059 | 37.0 | 2997 | 1.0784 | {'precision': 0.6126709863210943, 'recall': 0.586357372531006, 'f1-score': 0.5992254430231193, 'support': 4354.0} | {'precision': 0.7829153605015674, 'recall': 0.8505747126436781, 'f1-score': 0.8153438073862477, 'support': 2349.0} | {'precision': 0.928993490235353, 'recall': 0.9111984282907662, 'f1-score': 0.9200099181750558, 'support': 10180.0} | {'precision': 0.8924223419169187, 'recall': 0.9043666816210558, 'f1-score': 0.8983548111560886, 'support': 13374.0} | 0.8567 | {'precision': 0.8042505447437334, 'recall': 0.8131242987716265, 'f1-score': 0.8082334949351277, 'support': 30257.0} | {'precision': 0.855968793590012, 'recall': 0.8567273688733186, 'f1-score': 0.8561512507484733, 'support': 30257.0} |
110
+ | 0.0056 | 38.0 | 3078 | 1.0627 | {'precision': 0.6600834492350487, 'recall': 0.545016077170418, 'f1-score': 0.5970562334884891, 'support': 4354.0} | {'precision': 0.7832877782116361, 'recall': 0.853980417198808, 'f1-score': 0.8171079429735234, 'support': 2349.0} | {'precision': 0.9168210628961482, 'recall': 0.9235756385068762, 'f1-score': 0.9201859554685589, 'support': 10180.0} | {'precision': 0.886320959121768, 'recall': 0.917601315986242, 'f1-score': 0.9016899338721528, 'support': 13374.0} | 0.8611 | {'precision': 0.8116283123661503, 'recall': 0.810043362215586, 'f1-score': 0.809010016450681, 'support': 30257.0} | {'precision': 0.8560280681021202, 'recall': 0.8610569455002148, 'f1-score': 0.857509455693882, 'support': 30257.0} |
111
+ | 0.0056 | 39.0 | 3159 | 1.0807 | {'precision': 0.6121442975576966, 'recall': 0.6274689940284796, 'f1-score': 0.6197119201542475, 'support': 4354.0} | {'precision': 0.7752365930599369, 'recall': 0.8369518944231588, 'f1-score': 0.8049129989764585, 'support': 2349.0} | {'precision': 0.9239475774424146, 'recall': 0.9141453831041257, 'f1-score': 0.9190203436697609, 'support': 10180.0} | {'precision': 0.9063400576368876, 'recall': 0.8935995214595484, 'f1-score': 0.8999246987951808, 'support': 13374.0} | 0.8578 | {'precision': 0.8044171314242339, 'recall': 0.8180414482538281, 'f1-score': 0.8108924903989119, 'support': 30257.0} | {'precision': 0.8597509765628951, 'recall': 0.8578180255808573, 'f1-score': 0.8586504397393069, 'support': 30257.0} |
112
+ | 0.0056 | 40.0 | 3240 | 1.0857 | {'precision': 0.6403553299492386, 'recall': 0.5794671566375746, 'f1-score': 0.6083916083916084, 'support': 4354.0} | {'precision': 0.7841639871382636, 'recall': 0.8305661983822903, 'f1-score': 0.806698366756254, 'support': 2349.0} | {'precision': 0.9327577450482478, 'recall': 0.9020628683693517, 'f1-score': 0.9171535580524344, 'support': 10180.0} | {'precision': 0.8838672768878718, 'recall': 0.924181247196052, 'f1-score': 0.9035748227209591, 'support': 13374.0} | 0.8599 | {'precision': 0.8102860847559054, 'recall': 0.8090693676463172, 'f1-score': 0.808954588980314, 'support': 30257.0} | {'precision': 0.8575345578899536, 'recall': 0.8598671381828998, 'f1-score': 0.8581453688895593, 'support': 30257.0} |
113
+ | 0.0056 | 41.0 | 3321 | 1.0827 | {'precision': 0.616471099521947, 'recall': 0.6515847496554892, 'f1-score': 0.633541759714158, 'support': 4354.0} | {'precision': 0.7827640984908658, 'recall': 0.8390804597701149, 'f1-score': 0.8099445243476474, 'support': 2349.0} | {'precision': 0.9238968024703655, 'recall': 0.9111001964636543, 'f1-score': 0.9174538800138484, 'support': 10180.0} | {'precision': 0.907924874026569, 'recall': 0.889187976671153, 'f1-score': 0.8984587488667273, 'support': 13374.0} | 0.8585 | {'precision': 0.8077642186274367, 'recall': 0.8227383456401028, 'f1-score': 0.8148497282355953, 'support': 30257.0} | {'precision': 0.8616414300510049, 'recall': 0.8584790296460323, 'f1-score': 0.8598561759385482, 'support': 30257.0} |
114
+ | 0.0056 | 42.0 | 3402 | 1.1027 | {'precision': 0.6000876040297853, 'recall': 0.6293063849333945, 'f1-score': 0.6143497757847534, 'support': 4354.0} | {'precision': 0.7960687960687961, 'recall': 0.8275862068965517, 'f1-score': 0.8115216030056356, 'support': 2349.0} | {'precision': 0.9348998067338012, 'recall': 0.9028487229862475, 'f1-score': 0.9185947728749189, 'support': 10180.0} | {'precision': 0.8968549709345655, 'recall': 0.8998055929415283, 'f1-score': 0.8983278590624066, 'support': 13374.0} | 0.8563 | {'precision': 0.806977794441737, 'recall': 0.8148867269394304, 'f1-score': 0.8106985026819286, 'support': 30257.0} | {'precision': 0.8591256715384956, 'recall': 0.8562977162309549, 'f1-score': 0.8575428741842996, 'support': 30257.0} |
115
+ | 0.0056 | 43.0 | 3483 | 1.0912 | {'precision': 0.6053575195106518, 'recall': 0.6591639871382636, 'f1-score': 0.6311159978009895, 'support': 4354.0} | {'precision': 0.8087291399229781, 'recall': 0.8045977011494253, 'f1-score': 0.8066581306017925, 'support': 2349.0} | {'precision': 0.9296835760924159, 'recall': 0.9091355599214146, 'f1-score': 0.9192947603675194, 'support': 10180.0} | {'precision': 0.904794313369631, 'recall': 0.8946463286974727, 'f1-score': 0.8996917061433192, 'support': 13374.0} | 0.8586 | {'precision': 0.8121411372239192, 'recall': 0.816885894226644, 'f1-score': 0.8141901487284051, 'support': 30257.0} | {'precision': 0.8626211898487851, 'recall': 0.8586442806623261, 'f1-score': 0.8604163182639131, 'support': 30257.0} |
116
+ | 0.0038 | 44.0 | 3564 | 1.0970 | {'precision': 0.6089013115459041, 'recall': 0.6504363803399174, 'f1-score': 0.6289838978345363, 'support': 4354.0} | {'precision': 0.7846758349705305, 'recall': 0.8501489995742869, 'f1-score': 0.8161013485901104, 'support': 2349.0} | {'precision': 0.9292533413727263, 'recall': 0.9083497053045186, 'f1-score': 0.9186826287814813, 'support': 10180.0} | {'precision': 0.9074752097635392, 'recall': 0.8895618363989831, 'f1-score': 0.8984292402960278, 'support': 13374.0} | 0.8584 | {'precision': 0.807576424413175, 'recall': 0.8246242304044265, 'f1-score': 0.815549278875539, 'support': 30257.0} | {'precision': 0.8623040062586698, 'recall': 0.8584129292395148, 'f1-score': 0.860078652203599, 'support': 30257.0} |
117
+ | 0.0038 | 45.0 | 3645 | 1.0909 | {'precision': 0.6125760649087221, 'recall': 0.6242535599448783, 'f1-score': 0.6183596860425435, 'support': 4354.0} | {'precision': 0.8168358714043993, 'recall': 0.8220519369944658, 'f1-score': 0.8194356036494802, 'support': 2349.0} | {'precision': 0.9284640817553351, 'recall': 0.9103143418467583, 'f1-score': 0.9192996379147859, 'support': 10180.0} | {'precision': 0.8955844155844156, 'recall': 0.9023478390907731, 'f1-score': 0.8989534060858877, 'support': 13374.0} | 0.8588 | {'precision': 0.813365108413218, 'recall': 0.8147419194692188, 'f1-score': 0.8140120834231743, 'support': 30257.0} | {'precision': 0.8598081096882307, 'recall': 0.8587764814753611, 'f1-score': 0.8592479582565041, 'support': 30257.0} |
118
+ | 0.0038 | 46.0 | 3726 | 1.0958 | {'precision': 0.613838242169238, 'recall': 0.6031235645383556, 'f1-score': 0.6084337349397592, 'support': 4354.0} | {'precision': 0.7956, 'recall': 0.8467432950191571, 'f1-score': 0.8203753351206435, 'support': 2349.0} | {'precision': 0.9285857572718155, 'recall': 0.9094302554027505, 'f1-score': 0.918908188585608, 'support': 10180.0} | {'precision': 0.8941446443111999, 'recall': 0.9031703304919994, 'f1-score': 0.8986348249823308, 'support': 13374.0} | 0.8577 | {'precision': 0.8080421609380632, 'recall': 0.8156168613630657, 'f1-score': 0.8115880209070854, 'support': 30257.0} | {'precision': 0.8577456320339072, 'recall': 0.8577188749710811, 'f1-score': 0.8576200434028913, 'support': 30257.0} |
119
+ | 0.0038 | 47.0 | 3807 | 1.0941 | {'precision': 0.6171088746569076, 'recall': 0.6196600826825908, 'f1-score': 0.6183818473527389, 'support': 4354.0} | {'precision': 0.7963466770307035, 'recall': 0.8722860791826309, 'f1-score': 0.8325883787078424, 'support': 2349.0} | {'precision': 0.9271238893880404, 'recall': 0.9122789783889981, 'f1-score': 0.9196415309204337, 'support': 10180.0} | {'precision': 0.8996615268898082, 'recall': 0.8943472409152086, 'f1-score': 0.8969965128051295, 'support': 13374.0} | 0.8591 | {'precision': 0.810060241991365, 'recall': 0.824643095292357, 'f1-score': 0.8169020674465362, 'support': 30257.0} | {'precision': 0.8602209352941748, 'recall': 0.8591400337112073, 'f1-score': 0.8595223191983462, 'support': 30257.0} |
120
+ | 0.0038 | 48.0 | 3888 | 1.0953 | {'precision': 0.6142533936651584, 'recall': 0.6235645383555352, 'f1-score': 0.6188739457488033, 'support': 4354.0} | {'precision': 0.7976516634050881, 'recall': 0.8676032354193274, 'f1-score': 0.8311582381729201, 'support': 2349.0} | {'precision': 0.9256420465857057, 'recall': 0.9134577603143419, 'f1-score': 0.91950954217344, 'support': 10180.0} | {'precision': 0.9016319129646418, 'recall': 0.892328398384926, 'f1-score': 0.89695603156708, 'support': 13374.0} | 0.8588 | {'precision': 0.8097947541551485, 'recall': 0.8242384831185325, 'f1-score': 0.8166244394155608, 'support': 30257.0} | {'precision': 0.8602837119208202, 'recall': 0.8588425818818786, 'f1-score': 0.8594198025832774, 'support': 30257.0} |
121
+ | 0.0038 | 49.0 | 3969 | 1.0902 | {'precision': 0.6190804597701149, 'recall': 0.6185117133670188, 'f1-score': 0.6187959558823529, 'support': 4354.0} | {'precision': 0.7996062992125984, 'recall': 0.8646232439335888, 'f1-score': 0.8308447535283289, 'support': 2349.0} | {'precision': 0.9244590033750248, 'recall': 0.9148330058939096, 'f1-score': 0.9196208156413548, 'support': 10180.0} | {'precision': 0.9003987060859099, 'recall': 0.8949454164797368, 'f1-score': 0.8976637792027601, 'support': 13374.0} | 0.8595 | {'precision': 0.810886117110912, 'recall': 0.8232283449185636, 'f1-score': 0.8167313260636991, 'support': 30257.0} | {'precision': 0.8601869474250647, 'recall': 0.8595035859470536, 'f1-score': 0.8597345144672809, 'support': 30257.0} |
122
+ | 0.0031 | 50.0 | 4050 | 1.0920 | {'precision': 0.6182355616189177, 'recall': 0.6244832338079926, 'f1-score': 0.6213436928702011, 'support': 4354.0} | {'precision': 0.8, 'recall': 0.86504895700298, 'f1-score': 0.8312538351401105, 'support': 2349.0} | {'precision': 0.9246820349761526, 'recall': 0.9141453831041257, 'f1-score': 0.919383521043272, 'support': 10180.0} | {'precision': 0.9017729158807997, 'recall': 0.8937490653506804, 'f1-score': 0.8977430620751813, 'support': 13374.0} | 0.8596 | {'precision': 0.8111726281189675, 'recall': 0.8243566598164448, 'f1-score': 0.8174310277821912, 'support': 30257.0} | {'precision': 0.8607783894085936, 'recall': 0.8596357867600886, 'f1-score': 0.8600881004037069, 'support': 30257.0} |
123
 
124
 
125
  ### Framework versions
meta_data/README_s42_e50.md CHANGED
@@ -17,12 +17,12 @@ model-index:
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
- split: train[0%:20%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
- value: 0.8424353991954728
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,14 +32,14 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 1.2704
36
- - Claim: {'precision': 0.5972354623450906, 'recall': 0.5879868606288128, 'f1-score': 0.5925750768503193, 'support': 4262.0}
37
- - Majorclaim: {'precision': 0.8091328886608518, 'recall': 0.7284064665127021, 'f1-score': 0.7666504618376278, 'support': 2165.0}
38
- - O: {'precision': 0.9211161229413616, 'recall': 0.8898459667612485, 'f1-score': 0.9052110715942477, 'support': 9868.0}
39
- - Premise: {'precision': 0.8676039835969537, 'recall': 0.9086586394662167, 'f1-score': 0.8876568645813823, 'support': 13039.0}
40
- - Accuracy: 0.8424
41
- - Macro avg: {'precision': 0.7987721143860643, 'recall': 0.7787244833422451, 'f1-score': 0.7880233687158943, 'support': 29334.0}
42
- - Weighted avg: {'precision': 0.8420076528182845, 'recall': 0.8424353991954728, 'f1-score': 0.8417581625139158, 'support': 29334.0}
43
 
44
  ## Model description
45
 
@@ -68,58 +68,58 @@ The following hyperparameters were used during training:
68
 
69
  ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
- |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
- | No log | 1.0 | 81 | 0.5471 | {'precision': 0.45446915652538816, 'recall': 0.5082121069920226, 'f1-score': 0.4798404962339389, 'support': 4262.0} | {'precision': 0.5914396887159533, 'recall': 0.6318706697459584, 'f1-score': 0.6109870477891916, 'support': 2165.0} | {'precision': 0.9164132026585559, 'recall': 0.8243818402918525, 'f1-score': 0.8679647906108295, 'support': 9868.0} | {'precision': 0.852593810734041, 'recall': 0.8747603343814709, 'f1-score': 0.8635348449861832, 'support': 13039.0} | 0.7866 | {'precision': 0.7037289646584846, 'recall': 0.709806237852826, 'f1-score': 0.7055817949050358, 'support': 29334.0} | {'precision': 0.7969438417255414, 'recall': 0.7866298493216063, 'f1-score': 0.7906379815550267, 'support': 29334.0} |
74
- | No log | 2.0 | 162 | 0.5196 | {'precision': 0.5064490124949617, 'recall': 0.5896292820272173, 'f1-score': 0.5448829141370338, 'support': 4262.0} | {'precision': 0.5564053537284895, 'recall': 0.8064665127020785, 'f1-score': 0.6584951914010938, 'support': 2165.0} | {'precision': 0.9374127501163332, 'recall': 0.8165788406972031, 'f1-score': 0.8728336221837087, 'support': 9868.0} | {'precision': 0.8852666561164741, 'recall': 0.858041260832886, 'f1-score': 0.8714413677610314, 'support': 13039.0} | 0.8013 | {'precision': 0.7213834431140647, 'recall': 0.7676789740648462, 'f1-score': 0.7369132738707169, 'support': 29334.0} | {'precision': 0.8234977919590369, 'recall': 0.8012886070771119, 'f1-score': 0.8087468210056704, 'support': 29334.0} |
75
- | No log | 3.0 | 243 | 0.5239 | {'precision': 0.5717288491854966, 'recall': 0.5105584232754575, 'f1-score': 0.5394149727317799, 'support': 4262.0} | {'precision': 0.7751024590163934, 'recall': 0.6988452655889146, 'f1-score': 0.7350012144765606, 'support': 2165.0} | {'precision': 0.9378775789353699, 'recall': 0.8338062423996757, 'f1-score': 0.8827852583015933, 'support': 9868.0} | {'precision': 0.8284131594946971, 'recall': 0.9404862336068717, 'f1-score': 0.8808993606781121, 'support': 13039.0} | 0.8243 | {'precision': 0.7782805116579892, 'recall': 0.7459240412177299, 'f1-score': 0.7595252015470114, 'support': 29334.0} | {'precision': 0.8240083287170064, 'recall': 0.8242994477398241, 'f1-score': 0.8211507443896716, 'support': 29334.0} |
76
- | No log | 4.0 | 324 | 0.4756 | {'precision': 0.5839096357768557, 'recall': 0.5943219145940872, 'f1-score': 0.5890697674418606, 'support': 4262.0} | {'precision': 0.7539079946404645, 'recall': 0.7796766743648961, 'f1-score': 0.7665758401453224, 'support': 2165.0} | {'precision': 0.9029426948890036, 'recall': 0.8861978111066072, 'f1-score': 0.8944918938270342, 'support': 9868.0} | {'precision': 0.8858629130966952, 'recall': 0.8881049160211673, 'f1-score': 0.8869824977978629, 'support': 13039.0} | 0.8368 | {'precision': 0.7816558096007548, 'recall': 0.7870753290216894, 'f1-score': 0.7842799998030201, 'support': 29334.0} | {'precision': 0.8379981834427648, 'recall': 0.8367764368991614, 'f1-score': 0.8373376573199475, 'support': 29334.0} |
77
- | No log | 5.0 | 405 | 0.5507 | {'precision': 0.5626541134274826, 'recall': 0.5889253871421868, 'f1-score': 0.575490083686805, 'support': 4262.0} | {'precision': 0.7744245524296676, 'recall': 0.6993071593533488, 'f1-score': 0.7349514563106796, 'support': 2165.0} | {'precision': 0.9094442693560247, 'recall': 0.8772800972841508, 'f1-score': 0.893072677567442, 'support': 9868.0} | {'precision': 0.8688708112545712, 'recall': 0.8928598818927832, 'f1-score': 0.8807020198199561, 'support': 13039.0} | 0.8292 | {'precision': 0.7788484366169366, 'recall': 0.7645931314181174, 'f1-score': 0.7710540593462206, 'support': 29334.0} | {'precision': 0.8310582786320232, 'recall': 0.8291743369468876, 'f1-score': 0.8297614869521274, 'support': 29334.0} |
78
- | No log | 6.0 | 486 | 0.6030 | {'precision': 0.5614867536575722, 'recall': 0.666353824495542, 'f1-score': 0.6094420600858369, 'support': 4262.0} | {'precision': 0.7341541267669859, 'recall': 0.74364896073903, 'f1-score': 0.7388710417622762, 'support': 2165.0} | {'precision': 0.918757975329647, 'recall': 0.8755573571139035, 'f1-score': 0.896637608966376, 'support': 9868.0} | {'precision': 0.8982569603281015, 'recall': 0.873456553416673, 'f1-score': 0.8856831790963526, 'support': 13039.0} | 0.8345 | {'precision': 0.7781639540205766, 'recall': 0.7897541739412871, 'f1-score': 0.7826584724777105, 'support': 29334.0} | {'precision': 0.8441118304632907, 'recall': 0.8344923979000477, 'f1-score': 0.8383971078959127, 'support': 29334.0} |
79
- | 0.3501 | 7.0 | 567 | 0.7000 | {'precision': 0.5986996098829649, 'recall': 0.5401220084467386, 'f1-score': 0.5679042802516344, 'support': 4262.0} | {'precision': 0.8235613463626493, 'recall': 0.7006928406466513, 'f1-score': 0.7571749438482656, 'support': 2165.0} | {'precision': 0.9108108108108108, 'recall': 0.8879205512768544, 'f1-score': 0.8992200328407225, 'support': 9868.0} | {'precision': 0.8537819918728167, 'recall': 0.9184753432011658, 'f1-score': 0.8849479051208157, 'support': 13039.0} | 0.8372 | {'precision': 0.7967134397323103, 'recall': 0.7618026858928525, 'f1-score': 0.7773117905153596, 'support': 29334.0} | {'precision': 0.833674661665885, 'recall': 0.8371514283766278, 'f1-score': 0.834254817440735, 'support': 29334.0} |
80
- | 0.3501 | 8.0 | 648 | 0.7253 | {'precision': 0.5610444601270289, 'recall': 0.5595964335992492, 'f1-score': 0.5603195113356043, 'support': 4262.0} | {'precision': 0.8215042372881356, 'recall': 0.7163972286374134, 'f1-score': 0.765358993338268, 'support': 2165.0} | {'precision': 0.9208110992529349, 'recall': 0.8743413052290231, 'f1-score': 0.8969747374987005, 'support': 9868.0} | {'precision': 0.8566365280289331, 'recall': 0.9082751744765702, 'f1-score': 0.8817004169148303, 'support': 13039.0} | 0.8320 | {'precision': 0.7899990811742581, 'recall': 0.764652535485564, 'f1-score': 0.7760884147718508, 'support': 29334.0} | {'precision': 0.8326847950905921, 'recall': 0.8320379082293584, 'f1-score': 0.8315580017617559, 'support': 29334.0} |
81
- | 0.3501 | 9.0 | 729 | 0.7606 | {'precision': 0.575776926351639, 'recall': 0.6346785546691694, 'f1-score': 0.6037946428571428, 'support': 4262.0} | {'precision': 0.7266247379454926, 'recall': 0.8004618937644342, 'f1-score': 0.7617582417582419, 'support': 2165.0} | {'precision': 0.9148418491484185, 'recall': 0.8763680583704905, 'f1-score': 0.8951917602608561, 'support': 9868.0} | {'precision': 0.8901390842319112, 'recall': 0.873686632410461, 'f1-score': 0.8818361264852731, 'support': 13039.0} | 0.8345 | {'precision': 0.7768456494193653, 'recall': 0.7962987848036388, 'f1-score': 0.7856451928403785, 'support': 29334.0} | {'precision': 0.8407065761389229, 'recall': 0.8344583077657326, 'f1-score': 0.8370693701765644, 'support': 29334.0} |
82
- | 0.3501 | 10.0 | 810 | 0.8529 | {'precision': 0.5611362700699877, 'recall': 0.639605818864383, 'f1-score': 0.5978070175438598, 'support': 4262.0} | {'precision': 0.8085327783558793, 'recall': 0.7177829099307159, 'f1-score': 0.760459995106435, 'support': 2165.0} | {'precision': 0.9375900676199977, 'recall': 0.8571139035265505, 'f1-score': 0.8955476732489809, 'support': 9868.0} | {'precision': 0.8664006502623217, 'recall': 0.8992254007209142, 'f1-score': 0.8825079030558481, 'support': 13039.0} | 0.8339 | {'precision': 0.7934149415770466, 'recall': 0.7784320082606409, 'f1-score': 0.7840806472387809, 'support': 29334.0} | {'precision': 0.8417254078619799, 'recall': 0.8339469557510056, 'f1-score': 0.8365219331064127, 'support': 29334.0} |
83
- | 0.3501 | 11.0 | 891 | 0.8182 | {'precision': 0.5611759619541721, 'recall': 0.6091037071797278, 'f1-score': 0.5841584158415842, 'support': 4262.0} | {'precision': 0.745115856428896, 'recall': 0.7575057736720554, 'f1-score': 0.7512597343105818, 'support': 2165.0} | {'precision': 0.9214115609439273, 'recall': 0.8625861370085124, 'f1-score': 0.8910289961268711, 'support': 9868.0} | {'precision': 0.8729369206420982, 'recall': 0.8883349950149552, 'f1-score': 0.8805686483199028, 'support': 13039.0} | 0.8294 | {'precision': 0.7751600749922735, 'recall': 0.7793826532188127, 'f1-score': 0.776753948649735, 'support': 29334.0} | {'precision': 0.8345135873274777, 'recall': 0.8294470580214086, 'f1-score': 0.8314777811523291, 'support': 29334.0} |
84
- | 0.3501 | 12.0 | 972 | 0.8319 | {'precision': 0.5907553551296505, 'recall': 0.6147348662599719, 'f1-score': 0.6025066114752213, 'support': 4262.0} | {'precision': 0.7414772727272727, 'recall': 0.7233256351039261, 'f1-score': 0.7322889876081365, 'support': 2165.0} | {'precision': 0.9154129405576013, 'recall': 0.881738954195379, 'f1-score': 0.8982604655964487, 'support': 9868.0} | {'precision': 0.8792350549616021, 'recall': 0.8956208298182375, 'f1-score': 0.8873523042437597, 'support': 13039.0} | 0.8374 | {'precision': 0.7817201558440317, 'recall': 0.7788550713443787, 'f1-score': 0.7801020922308914, 'support': 29334.0} | {'precision': 0.8393242789283376, 'recall': 0.8374241494511488, 'f1-score': 0.838191511754931, 'support': 29334.0} |
85
- | 0.0592 | 13.0 | 1053 | 0.8901 | {'precision': 0.5857348703170029, 'recall': 0.5722665415297982, 'f1-score': 0.5789223830999287, 'support': 4262.0} | {'precision': 0.765908035299582, 'recall': 0.7616628175519631, 'f1-score': 0.7637795275590551, 'support': 2165.0} | {'precision': 0.9286720867208672, 'recall': 0.8681597081475476, 'f1-score': 0.8973969517624261, 'support': 9868.0} | {'precision': 0.8617314385150812, 'recall': 0.9114962803896004, 'f1-score': 0.8859155454511572, 'support': 13039.0} | 0.8366 | {'precision': 0.7855116077131332, 'recall': 0.7783963369047273, 'f1-score': 0.7815036019681417, 'support': 29334.0} | {'precision': 0.8370779741008496, 'recall': 0.8365718960932707, 'f1-score': 0.8361599437876358, 'support': 29334.0} |
86
- | 0.0592 | 14.0 | 1134 | 1.0014 | {'precision': 0.5823915900131406, 'recall': 0.5199436884091976, 'f1-score': 0.5493987851741663, 'support': 4262.0} | {'precision': 0.7580798479087453, 'recall': 0.7367205542725174, 'f1-score': 0.7472475989693137, 'support': 2165.0} | {'precision': 0.9203320396722725, 'recall': 0.8651195784353466, 'f1-score': 0.8918721270371919, 'support': 9868.0} | {'precision': 0.8481164746625203, 'recall': 0.9203159751514687, 'f1-score': 0.8827423863469177, 'support': 13039.0} | 0.8300 | {'precision': 0.7772299880641695, 'recall': 0.7605249490671326, 'f1-score': 0.7678152243818974, 'support': 29334.0} | {'precision': 0.8271569887491997, 'recall': 0.8300265903047658, 'f1-score': 0.8273812231322469, 'support': 29334.0} |
87
- | 0.0592 | 15.0 | 1215 | 0.9525 | {'precision': 0.5900047370914259, 'recall': 0.5844673862036602, 'f1-score': 0.5872230080150872, 'support': 4262.0} | {'precision': 0.787819253438114, 'recall': 0.7408775981524249, 'f1-score': 0.7636277076886455, 'support': 2165.0} | {'precision': 0.9236014917421417, 'recall': 0.8783948115119579, 'f1-score': 0.9004311016464966, 'support': 9868.0} | {'precision': 0.8681615659922577, 'recall': 0.9115729733875297, 'f1-score': 0.889337822671156, 'support': 13039.0} | 0.8403 | {'precision': 0.7923967620659849, 'recall': 0.7788281923138932, 'f1-score': 0.7851549100053463, 'support': 29334.0} | {'precision': 0.8404679570689874, 'recall': 0.8402877207336197, 'f1-score': 0.8398966533088925, 'support': 29334.0} |
88
- | 0.0592 | 16.0 | 1296 | 0.9606 | {'precision': 0.5905569007263922, 'recall': 0.5722665415297982, 'f1-score': 0.5812678741658723, 'support': 4262.0} | {'precision': 0.6997189883580891, 'recall': 0.805080831408776, 'f1-score': 0.7487113402061856, 'support': 2165.0} | {'precision': 0.9022900763358779, 'recall': 0.8983583299554114, 'f1-score': 0.900319910628142, 'support': 9868.0} | {'precision': 0.8913718187461204, 'recall': 0.8810491602116727, 'f1-score': 0.8861804296679139, 'support': 13039.0} | 0.8364 | {'precision': 0.77098444604162, 'recall': 0.7891887157764146, 'f1-score': 0.7791198886670285, 'support': 29334.0} | {'precision': 0.8371937253222967, 'recall': 0.8364014454216949, 'f1-score': 0.8364896444998899, 'support': 29334.0} |
89
- | 0.0592 | 17.0 | 1377 | 1.0477 | {'precision': 0.5815651380333106, 'recall': 0.5980760206475833, 'f1-score': 0.589705031810295, 'support': 4262.0} | {'precision': 0.7966360856269113, 'recall': 0.7219399538106236, 'f1-score': 0.7574509328810274, 'support': 2165.0} | {'precision': 0.917960088691796, 'recall': 0.8810295905958654, 'f1-score': 0.8991157764103624, 'support': 9868.0} | {'precision': 0.8738718745376535, 'recall': 0.9059743845386916, 'f1-score': 0.889633618255074, 'support': 13039.0} | 0.8393 | {'precision': 0.7925082967224177, 'recall': 0.7767549873981909, 'f1-score': 0.7839763398391897, 'support': 29334.0} | {'precision': 0.8405329403077433, 'recall': 0.8392650167041659, 'f1-score': 0.8394903983537285, 'support': 29334.0} |
90
- | 0.0592 | 18.0 | 1458 | 1.0223 | {'precision': 0.5735161870503597, 'recall': 0.5985452839042703, 'f1-score': 0.5857634902411022, 'support': 4262.0} | {'precision': 0.7626000942063118, 'recall': 0.7478060046189376, 'f1-score': 0.7551305970149254, 'support': 2165.0} | {'precision': 0.9284857734656056, 'recall': 0.8630928252938792, 'f1-score': 0.8945958720655428, 'support': 9868.0} | {'precision': 0.8720382634289919, 'recall': 0.9088887184600046, 'f1-score': 0.8900822411656465, 'support': 13039.0} | 0.8365 | {'precision': 0.7841600795378172, 'recall': 0.7795832080692728, 'f1-score': 0.7813930501218043, 'support': 29334.0} | {'precision': 0.8395772728770206, 'recall': 0.8365037158246403, 'f1-score': 0.83742538167473, 'support': 29334.0} |
91
- | 0.0221 | 19.0 | 1539 | 1.0659 | {'precision': 0.5930577757478876, 'recall': 0.6093383388080713, 'f1-score': 0.6010878370558963, 'support': 4262.0} | {'precision': 0.6994195688225538, 'recall': 0.7792147806004619, 'f1-score': 0.7371640812759448, 'support': 2165.0} | {'precision': 0.922713610991842, 'recall': 0.8710985002026753, 'f1-score': 0.896163469557965, 'support': 9868.0} | {'precision': 0.8897709231118167, 'recall': 0.9025998926298029, 'f1-score': 0.8961394959262925, 'support': 13039.0} | 0.8403 | {'precision': 0.776240469668525, 'recall': 0.7905628780602528, 'f1-score': 0.7826387209540246, 'support': 29334.0} | {'precision': 0.8436938905863776, 'recall': 0.8402877207336197, 'f1-score': 0.8415456672283212, 'support': 29334.0} |
92
- | 0.0221 | 20.0 | 1620 | 1.1141 | {'precision': 0.5949911459650898, 'recall': 0.5518535898639136, 'f1-score': 0.5726110772976263, 'support': 4262.0} | {'precision': 0.8097686375321337, 'recall': 0.7274826789838337, 'f1-score': 0.7664233576642335, 'support': 2165.0} | {'precision': 0.9140376879102265, 'recall': 0.8749493311714633, 'f1-score': 0.8940664802733769, 'support': 9868.0} | {'precision': 0.8566118656182988, 'recall': 0.9190888871846, 'f1-score': 0.8867512671574975, 'support': 13039.0} | 0.8367 | {'precision': 0.7938523342564372, 'recall': 0.7683436218009527, 'f1-score': 0.7799630455981834, 'support': 29334.0} | {'precision': 0.8344612867135542, 'recall': 0.8367423467648463, 'f1-score': 0.8346891927657273, 'support': 29334.0} |
93
- | 0.0221 | 21.0 | 1701 | 1.0835 | {'precision': 0.5811926605504587, 'recall': 0.5945565462224308, 'f1-score': 0.5877986546045001, 'support': 4262.0} | {'precision': 0.8357461024498887, 'recall': 0.6933025404157044, 'f1-score': 0.7578894218631658, 'support': 2165.0} | {'precision': 0.9177489177489178, 'recall': 0.8808269152817186, 'f1-score': 0.8989089404829618, 'support': 9868.0} | {'precision': 0.8672211278908587, 'recall': 0.911649666385459, 'f1-score': 0.8888805802736859, 'support': 13039.0} | 0.8391 | {'precision': 0.8004772021600309, 'recall': 0.7700839170763282, 'f1-score': 0.7833693993060784, 'support': 29334.0} | {'precision': 0.8403380390667924, 'recall': 0.8390945660325901, 'f1-score': 0.8388414732096745, 'support': 29334.0} |
94
- | 0.0221 | 22.0 | 1782 | 1.0930 | {'precision': 0.6045955002393489, 'recall': 0.5926794931956828, 'f1-score': 0.5985781990521326, 'support': 4262.0} | {'precision': 0.7659963436928702, 'recall': 0.7741339491916859, 'f1-score': 0.7700436480588099, 'support': 2165.0} | {'precision': 0.9202473276042759, 'recall': 0.8898459667612485, 'f1-score': 0.9047913446676972, 'support': 9868.0} | {'precision': 0.8782213615373157, 'recall': 0.9042871385842473, 'f1-score': 0.8910636689967883, 'support': 13039.0} | 0.8445 | {'precision': 0.7922651332684526, 'recall': 0.7902366369332161, 'f1-score': 0.7911192151938571, 'support': 29334.0} | {'precision': 0.8443204836707991, 'recall': 0.8445489875230109, 'f1-score': 0.8442539357618283, 'support': 29334.0} |
95
- | 0.0221 | 23.0 | 1863 | 1.1053 | {'precision': 0.6242860690340204, 'recall': 0.5898639136555608, 'f1-score': 0.6065870430691278, 'support': 4262.0} | {'precision': 0.7682088868529546, 'recall': 0.77459584295612, 'f1-score': 0.7713891444342226, 'support': 2165.0} | {'precision': 0.916354556803995, 'recall': 0.8925820835022295, 'f1-score': 0.9043121149897331, 'support': 9868.0} | {'precision': 0.8755180580224985, 'recall': 0.9072781655034895, 'f1-score': 0.8911152122330608, 'support': 13039.0} | 0.8464 | {'precision': 0.7960918926783671, 'recall': 0.79108000140435, 'f1-score': 0.793350878681536, 'support': 29334.0} | {'precision': 0.8448335103073846, 'recall': 0.8464239449103429, 'f1-score': 0.8453785599743056, 'support': 29334.0} |
96
- | 0.0221 | 24.0 | 1944 | 1.1296 | {'precision': 0.5723617064707083, 'recall': 0.657907085875176, 'f1-score': 0.612160244514791, 'support': 4262.0} | {'precision': 0.74928092042186, 'recall': 0.7219399538106236, 'f1-score': 0.7353563867325336, 'support': 2165.0} | {'precision': 0.9411369740376008, 'recall': 0.8522496959870288, 'f1-score': 0.8944905339289514, 'support': 9868.0} | {'precision': 0.8760158055617684, 'recall': 0.9011427256691464, 'f1-score': 0.888401633146832, 'support': 13039.0} | 0.8361 | {'precision': 0.7846988516229843, 'recall': 0.7833098653354937, 'f1-score': 0.7826021995807769, 'support': 29334.0} | {'precision': 0.8444504170660131, 'recall': 0.8361287243471739, 'f1-score': 0.8390187162613489, 'support': 29334.0} |
97
- | 0.0121 | 25.0 | 2025 | 1.1851 | {'precision': 0.5420016077170418, 'recall': 0.6328015016424214, 'f1-score': 0.5838926174496645, 'support': 4262.0} | {'precision': 0.7453046266605589, 'recall': 0.751501154734411, 'f1-score': 0.7483900643974242, 'support': 2165.0} | {'precision': 0.9215119391797837, 'recall': 0.872111876773409, 'f1-score': 0.8961316186806892, 'support': 9868.0} | {'precision': 0.8868806481770022, 'recall': 0.8730730884270266, 'f1-score': 0.8799227053140096, 'support': 13039.0} | 0.8289 | {'precision': 0.7739247054335967, 'recall': 0.782371905394317, 'f1-score': 0.7770842514604469, 'support': 29334.0} | {'precision': 0.8379734082026378, 'recall': 0.8288675257380514, 'f1-score': 0.8326567734615568, 'support': 29334.0} |
98
- | 0.0121 | 26.0 | 2106 | 1.1608 | {'precision': 0.5844748858447488, 'recall': 0.5706241201313937, 'f1-score': 0.5774664608809212, 'support': 4262.0} | {'precision': 0.7811717576364546, 'recall': 0.7205542725173211, 'f1-score': 0.7496395963479097, 'support': 2165.0} | {'precision': 0.9070486397361912, 'recall': 0.8919740575597892, 'f1-score': 0.8994481912936848, 'support': 9868.0} | {'precision': 0.8734412114014252, 'recall': 0.9024465066339443, 'f1-score': 0.887706989551507, 'support': 13039.0} | 0.8373 | {'precision': 0.786534123654705, 'recall': 0.7713997392106121, 'f1-score': 0.7785653095185057, 'support': 29334.0} | {'precision': 0.8359522994181892, 'recall': 0.8372877889138883, 'f1-score': 0.8363911492062416, 'support': 29334.0} |
99
- | 0.0121 | 27.0 | 2187 | 1.2414 | {'precision': 0.5587455830388692, 'recall': 0.5936180197090568, 'f1-score': 0.5756541524459613, 'support': 4262.0} | {'precision': 0.7639377197388247, 'recall': 0.702540415704388, 'f1-score': 0.7319538017324351, 'support': 2165.0} | {'precision': 0.934953934953935, 'recall': 0.8535670855289825, 'f1-score': 0.8924087513905812, 'support': 9868.0} | {'precision': 0.8628857018687527, 'recall': 0.9136436843316206, 'f1-score': 0.8875395790650028, 'support': 13039.0} | 0.8314 | {'precision': 0.7801307349000954, 'recall': 0.7658423013185119, 'f1-score': 0.771889071158495, 'support': 29334.0} | {'precision': 0.8356375173838656, 'recall': 0.8313561055430558, 'f1-score': 0.832380040520428, 'support': 29334.0} |
100
- | 0.0121 | 28.0 | 2268 | 1.1803 | {'precision': 0.5745489078822412, 'recall': 0.5678085405912717, 'f1-score': 0.5711588388010385, 'support': 4262.0} | {'precision': 0.759923481587757, 'recall': 0.7339491916859122, 'f1-score': 0.7467105263157894, 'support': 2165.0} | {'precision': 0.9240980623059629, 'recall': 0.8747466558573166, 'f1-score': 0.8987453797698997, 'support': 9868.0} | {'precision': 0.8636230825420015, 'recall': 0.9067413145179845, 'f1-score': 0.8846571139960342, 'support': 13039.0} | 0.8340 | {'precision': 0.7805483835794906, 'recall': 0.7708114256631212, 'f1-score': 0.7753179647206904, 'support': 29334.0} | {'precision': 0.834313180443581, 'recall': 0.8339810458853207, 'f1-score': 0.8336664204475138, 'support': 29334.0} |
101
- | 0.0121 | 29.0 | 2349 | 1.1596 | {'precision': 0.577922077922078, 'recall': 0.6055842327545753, 'f1-score': 0.5914298808432631, 'support': 4262.0} | {'precision': 0.7678825201326386, 'recall': 0.748729792147806, 'f1-score': 0.7581852198316185, 'support': 2165.0} | {'precision': 0.9200716090985678, 'recall': 0.8853871098500202, 'f1-score': 0.9023961991324106, 'support': 9868.0} | {'precision': 0.8802503581931981, 'recall': 0.8952373648285912, 'f1-score': 0.887680608365019, 'support': 13039.0} | 0.8390 | {'precision': 0.7865316413366206, 'recall': 0.7837346248952481, 'f1-score': 0.7849229770430779, 'support': 29334.0} | {'precision': 0.841427033860259, 'recall': 0.8390263857639599, 'f1-score': 0.8400306231199138, 'support': 29334.0} |
102
- | 0.0121 | 30.0 | 2430 | 1.1079 | {'precision': 0.5908226343319068, 'recall': 0.5830595964335993, 'f1-score': 0.5869154463863959, 'support': 4262.0} | {'precision': 0.7353747714808044, 'recall': 0.7431870669745958, 'f1-score': 0.7392602802664829, 'support': 2165.0} | {'precision': 0.9172500261205726, 'recall': 0.8896432914471017, 'f1-score': 0.903235763156541, 'support': 9868.0} | {'precision': 0.8796469444236666, 'recall': 0.9019096556484393, 'f1-score': 0.8906392002423507, 'support': 13039.0} | 0.8397 | {'precision': 0.7807735940892376, 'recall': 0.779449902625934, 'f1-score': 0.7800126725129426, 'support': 29334.0} | {'precision': 0.8396847417289331, 'recall': 0.8397422785845776, 'f1-score': 0.8395754817639772, 'support': 29334.0} |
103
- | 0.0062 | 31.0 | 2511 | 1.2153 | {'precision': 0.5875237191650854, 'recall': 0.5811825434068513, 'f1-score': 0.5843359282849729, 'support': 4262.0} | {'precision': 0.7917981072555205, 'recall': 0.6956120092378753, 'f1-score': 0.7405950331940004, 'support': 2165.0} | {'precision': 0.9167449139280125, 'recall': 0.8904539927036887, 'f1-score': 0.9034082146712589, 'support': 9868.0} | {'precision': 0.8704423740004402, 'recall': 0.9099624204310146, 'f1-score': 0.889763779527559, 'support': 13039.0} | 0.8398 | {'precision': 0.7916272785872646, 'recall': 0.7693027414448574, 'f1-score': 0.7795257389194479, 'support': 29334.0} | {'precision': 0.8391084038495659, 'recall': 0.8398104588532079, 'f1-score': 0.8389680969813661, 'support': 29334.0} |
104
- | 0.0062 | 32.0 | 2592 | 1.2206 | {'precision': 0.5818530964954393, 'recall': 0.5687470671046457, 'f1-score': 0.5752254390128144, 'support': 4262.0} | {'precision': 0.7966280295047419, 'recall': 0.6983833718244804, 'f1-score': 0.7442776273689393, 'support': 2165.0} | {'precision': 0.9354697582850268, 'recall': 0.8667409809485205, 'f1-score': 0.89979485560991, 'support': 9868.0} | {'precision': 0.8528349968146103, 'recall': 0.9239972390520745, 'f1-score': 0.8869910918059338, 'support': 13039.0} | 0.8365 | {'precision': 0.7916964702749545, 'recall': 0.7644671647324303, 'f1-score': 0.7765722534493993, 'support': 29334.0} | {'precision': 0.8371135433068684, 'recall': 0.8364696256903252, 'f1-score': 0.835468206366078, 'support': 29334.0} |
105
- | 0.0062 | 33.0 | 2673 | 1.2003 | {'precision': 0.5884494054841058, 'recall': 0.5689816987329892, 'f1-score': 0.5785518310867231, 'support': 4262.0} | {'precision': 0.8168557536466775, 'recall': 0.6983833718244804, 'f1-score': 0.7529880478087649, 'support': 2165.0} | {'precision': 0.9152016546018614, 'recall': 0.8968382650993109, 'f1-score': 0.9059269116593306, 'support': 9868.0} | {'precision': 0.8656879929886064, 'recall': 0.9090421044558632, 'f1-score': 0.8868355093337323, 'support': 13039.0} | 0.8400 | {'precision': 0.7965487016803128, 'recall': 0.7683113600281608, 'f1-score': 0.7810755749721379, 'support': 29334.0} | {'precision': 0.8384597989025678, 'recall': 0.8399809095247835, 'f1-score': 0.8385880547506103, 'support': 29334.0} |
106
- | 0.0062 | 34.0 | 2754 | 1.1772 | {'precision': 0.5838150289017341, 'recall': 0.6161426560300328, 'f1-score': 0.5995433789954339, 'support': 4262.0} | {'precision': 0.7706552706552706, 'recall': 0.7496535796766743, 'f1-score': 0.7600093654881762, 'support': 2165.0} | {'precision': 0.9282564268043455, 'recall': 0.8745439805431698, 'f1-score': 0.9006000521784504, 'support': 9868.0} | {'precision': 0.873967095957716, 'recall': 0.9003757956898535, 'f1-score': 0.8869749168933212, 'support': 13039.0} | 0.8393 | {'precision': 0.7891734555797665, 'recall': 0.7851790029849326, 'f1-score': 0.7867819283888454, 'support': 29334.0} | {'precision': 0.8424483431528531, 'recall': 0.8392650167041659, 'f1-score': 0.8404261748765735, 'support': 29334.0} |
107
- | 0.0062 | 35.0 | 2835 | 1.1895 | {'precision': 0.606857679661813, 'recall': 0.6062881276396058, 'f1-score': 0.6065727699530515, 'support': 4262.0} | {'precision': 0.7335437330928765, 'recall': 0.751501154734411, 'f1-score': 0.7424138717773214, 'support': 2165.0} | {'precision': 0.9192592592592592, 'recall': 0.8803202269963518, 'f1-score': 0.8993684646443731, 'support': 9868.0} | {'precision': 0.8780578758949881, 'recall': 0.90290666462152, 'f1-score': 0.890308919726245, 'support': 13039.0} | 0.8410 | {'precision': 0.7844296369772342, 'recall': 0.7852540434979722, 'f1-score': 0.7846660065252478, 'support': 29334.0} | {'precision': 0.8418489339002468, 'recall': 0.8410377036885526, 'f1-score': 0.841216512966489, 'support': 29334.0} |
108
- | 0.0062 | 36.0 | 2916 | 1.1666 | {'precision': 0.6117251321480057, 'recall': 0.5973721257625528, 'f1-score': 0.6044634377967711, 'support': 4262.0} | {'precision': 0.7328311918475853, 'recall': 0.763972286374134, 'f1-score': 0.7480777928539123, 'support': 2165.0} | {'precision': 0.9175440425310122, 'recall': 0.8919740575597892, 'f1-score': 0.9045783875443194, 'support': 9868.0} | {'precision': 0.8791472751839063, 'recall': 0.8982283917478334, 'f1-score': 0.8885854102651645, 'support': 13039.0} | 0.8425 | {'precision': 0.7853119104276274, 'recall': 0.7878867153610773, 'f1-score': 0.7864262571150419, 'support': 29334.0} | {'precision': 0.8424107853134181, 'recall': 0.842503579464103, 'f1-score': 0.8423145935144672, 'support': 29334.0} |
109
- | 0.0062 | 37.0 | 2997 | 1.2146 | {'precision': 0.6104142011834319, 'recall': 0.6051149694978883, 'f1-score': 0.6077530340520797, 'support': 4262.0} | {'precision': 0.8113879003558719, 'recall': 0.7371824480369515, 'f1-score': 0.7725072604065828, 'support': 2165.0} | {'precision': 0.9233368532206969, 'recall': 0.8860964734495338, 'f1-score': 0.9043334367566449, 'support': 9868.0} | {'precision': 0.8682709186658865, 'recall': 0.9104225784185904, 'f1-score': 0.888847291378084, 'support': 13039.0} | 0.8451 | {'precision': 0.8033524683564718, 'recall': 0.7847041173507411, 'f1-score': 0.7933602556483479, 'support': 29334.0} | {'precision': 0.845132361961566, 'recall': 0.845094429672053, 'f1-score': 0.8446295710132824, 'support': 29334.0} |
110
- | 0.0043 | 38.0 | 3078 | 1.2219 | {'precision': 0.607548995886765, 'recall': 0.5891600187705303, 'f1-score': 0.5982132221560452, 'support': 4262.0} | {'precision': 0.8046558704453441, 'recall': 0.7344110854503464, 'f1-score': 0.7679304515817436, 'support': 2165.0} | {'precision': 0.9161189358372457, 'recall': 0.8898459667612485, 'f1-score': 0.902791343237547, 'support': 9868.0} | {'precision': 0.8706011730205279, 'recall': 0.9107293504103076, 'f1-score': 0.8902132763596836, 'support': 13039.0} | 0.8440 | {'precision': 0.7997312437974707, 'recall': 0.7810366053481081, 'f1-score': 0.7897870733337549, 'support': 29334.0} | {'precision': 0.842826894860577, 'recall': 0.8439694552396536, 'f1-score': 0.8429941387477182, 'support': 29334.0} |
111
- | 0.0043 | 39.0 | 3159 | 1.2388 | {'precision': 0.5807318585900352, 'recall': 0.6590802440168935, 'f1-score': 0.6174304868666887, 'support': 4262.0} | {'precision': 0.8076535750251762, 'recall': 0.7408775981524249, 'f1-score': 0.7728258251023848, 'support': 2165.0} | {'precision': 0.9215976331360947, 'recall': 0.8838670449939198, 'f1-score': 0.9023380922822264, 'support': 9868.0} | {'precision': 0.8848011037020005, 'recall': 0.8853439680957128, 'f1-score': 0.8850724526565974, 'support': 13039.0} | 0.8413 | {'precision': 0.7986960426133265, 'recall': 0.7922922138147377, 'f1-score': 0.7944167142269745, 'support': 29334.0} | {'precision': 0.8473067500578716, 'recall': 0.8413104247630736, 'f1-score': 0.8437099833368404, 'support': 29334.0} |
112
- | 0.0043 | 40.0 | 3240 | 1.2564 | {'precision': 0.6038774533269506, 'recall': 0.5919755983106523, 'f1-score': 0.597867298578199, 'support': 4262.0} | {'precision': 0.8135162601626016, 'recall': 0.7394919168591224, 'f1-score': 0.7747398983789014, 'support': 2165.0} | {'precision': 0.9209081309398099, 'recall': 0.8837657073368463, 'f1-score': 0.9019547005895129, 'support': 9868.0} | {'precision': 0.8650677941390873, 'recall': 0.9101158064268732, 'f1-score': 0.8870202190081099, 'support': 13039.0} | 0.8424 | {'precision': 0.8008424096421124, 'recall': 0.7813372572333735, 'f1-score': 0.7903955291386808, 'support': 29334.0} | {'precision': 0.8420988891124668, 'recall': 0.8424353991954728, 'f1-score': 0.8417456851297015, 'support': 29334.0} |
113
- | 0.0043 | 41.0 | 3321 | 1.2344 | {'precision': 0.6037467393881907, 'recall': 0.5973721257625528, 'f1-score': 0.6005425168062271, 'support': 4262.0} | {'precision': 0.8185071574642127, 'recall': 0.7394919168591224, 'f1-score': 0.7769958747876727, 'support': 2165.0} | {'precision': 0.9191644908616188, 'recall': 0.8918727199027159, 'f1-score': 0.9053129661060536, 'support': 9868.0} | {'precision': 0.8714853525688209, 'recall': 0.9080450954827824, 'f1-score': 0.8893896713615024, 'support': 13039.0} | 0.8450 | {'precision': 0.8032259350707107, 'recall': 0.7841954645017934, 'f1-score': 0.793060257265364, 'support': 29334.0} | {'precision': 0.8447143010550829, 'recall': 0.8450262494034226, 'f1-score': 0.8444838259344317, 'support': 29334.0} |
114
- | 0.0043 | 42.0 | 3402 | 1.2454 | {'precision': 0.607732085693179, 'recall': 0.5790708587517598, 'f1-score': 0.5930553886819657, 'support': 4262.0} | {'precision': 0.8161802355350742, 'recall': 0.7362586605080832, 'f1-score': 0.7741622146673143, 'support': 2165.0} | {'precision': 0.9137449581135588, 'recall': 0.8953182002432104, 'f1-score': 0.9044377335312486, 'support': 9868.0} | {'precision': 0.869606622225478, 'recall': 0.9104225784185904, 'f1-score': 0.8895466466841514, 'support': 13039.0} | 0.8443 | {'precision': 0.8018159753918225, 'recall': 0.780267574480411, 'f1-score': 0.79030049589117, 'support': 29334.0} | {'precision': 0.8424633651401231, 'recall': 0.8443444467171201, 'f1-score': 0.8429622125151117, 'support': 29334.0} |
115
- | 0.0043 | 43.0 | 3483 | 1.2396 | {'precision': 0.5977417078334509, 'recall': 0.5961989676208352, 'f1-score': 0.5969693410078702, 'support': 4262.0} | {'precision': 0.8070805541303232, 'recall': 0.7265588914549653, 'f1-score': 0.764705882352941, 'support': 2165.0} | {'precision': 0.9202486304256215, 'recall': 0.8851844345358735, 'f1-score': 0.9023760330578511, 'support': 9868.0} | {'precision': 0.8693739920832723, 'recall': 0.9095789554413682, 'f1-score': 0.8890221505940558, 'support': 13039.0} | 0.8423 | {'precision': 0.798611221118167, 'recall': 0.7793803122632605, 'f1-score': 0.7882683517531794, 'support': 29334.0} | {'precision': 0.8424246787445332, 'recall': 0.8423331287925274, 'f1-score': 0.8419062549424022, 'support': 29334.0} |
116
- | 0.0034 | 44.0 | 3564 | 1.2523 | {'precision': 0.6167139540882125, 'recall': 0.5610042233693102, 'f1-score': 0.5875414670106893, 'support': 4262.0} | {'precision': 0.8153061224489796, 'recall': 0.7381062355658199, 'f1-score': 0.7747878787878788, 'support': 2165.0} | {'precision': 0.9169854233433268, 'recall': 0.8988650182407782, 'f1-score': 0.9078348088634154, 'support': 9868.0} | {'precision': 0.8653067129629629, 'recall': 0.9174016412301557, 'f1-score': 0.8905930089714477, 'support': 13039.0} | 0.8462 | {'precision': 0.8035780532108705, 'recall': 0.7788442796015159, 'f1-score': 0.7901892909083578, 'support': 29334.0} | {'precision': 0.8428826281892011, 'recall': 0.8461512238358219, 'f1-score': 0.8438151506040159, 'support': 29334.0} |
117
- | 0.0034 | 45.0 | 3645 | 1.2569 | {'precision': 0.5956501403180543, 'recall': 0.5976067573908963, 'f1-score': 0.5966268446943078, 'support': 4262.0} | {'precision': 0.8109375, 'recall': 0.7191685912240184, 'f1-score': 0.7623011015911872, 'support': 2165.0} | {'precision': 0.9264893617021277, 'recall': 0.882549655451966, 'f1-score': 0.9039858833298734, 'support': 9868.0} | {'precision': 0.8643907410103363, 'recall': 0.9107293504103076, 'f1-score': 0.8869552227658065, 'support': 13039.0} | 0.8416 | {'precision': 0.7993669357576295, 'recall': 0.777513588619297, 'f1-score': 0.7874672630952938, 'support': 29334.0} | {'precision': 0.8422897824656003, 'recall': 0.8416172359719097, 'f1-score': 0.8413018116647781, 'support': 29334.0} |
118
- | 0.0034 | 46.0 | 3726 | 1.2538 | {'precision': 0.5921505623135185, 'recall': 0.6053496011262318, 'f1-score': 0.5986773407587886, 'support': 4262.0} | {'precision': 0.8124022928608651, 'recall': 0.7200923787528868, 'f1-score': 0.7634671890303624, 'support': 2165.0} | {'precision': 0.9249020230907743, 'recall': 0.8848804215646534, 'f1-score': 0.9044487026775078, 'support': 9868.0} | {'precision': 0.8677388558419622, 'recall': 0.9062044635324795, 'f1-score': 0.8865546218487395, 'support': 13039.0} | 0.8416 | {'precision': 0.79929843352678, 'recall': 0.779131716244063, 'f1-score': 0.7882869635788495, 'support': 29334.0} | {'precision': 0.8428436887504975, 'recall': 0.8415831458375946, 'f1-score': 0.8416634213837886, 'support': 29334.0} |
119
- | 0.0034 | 47.0 | 3807 | 1.2729 | {'precision': 0.5972959922742637, 'recall': 0.5804786485218207, 'f1-score': 0.5887672536887196, 'support': 4262.0} | {'precision': 0.8081907724209435, 'recall': 0.7200923787528868, 'f1-score': 0.7616023448949681, 'support': 2165.0} | {'precision': 0.9219409282700421, 'recall': 0.8856911228212404, 'f1-score': 0.9034525532354765, 'support': 9868.0} | {'precision': 0.8636000870637742, 'recall': 0.9128767543523276, 'f1-score': 0.8875549921706063, 'support': 13039.0} | 0.8412 | {'precision': 0.7977569450072559, 'recall': 0.7747847261120688, 'f1-score': 0.7853442859974425, 'support': 29334.0} | {'precision': 0.8404446429657594, 'recall': 0.8412081543601282, 'f1-score': 0.8401954881761488, 'support': 29334.0} |
120
- | 0.0034 | 48.0 | 3888 | 1.2605 | {'precision': 0.5967088003815884, 'recall': 0.5870483341154388, 'f1-score': 0.5918391484328799, 'support': 4262.0} | {'precision': 0.8079877112135176, 'recall': 0.7288683602771363, 'f1-score': 0.7663914521612433, 'support': 2165.0} | {'precision': 0.9202300052273915, 'recall': 0.8919740575597892, 'f1-score': 0.9058817475428395, 'support': 9868.0} | {'precision': 0.8690449974308155, 'recall': 0.9079684024848531, 'f1-score': 0.8880804140724626, 'support': 13039.0} | 0.8427 | {'precision': 0.7984928785633282, 'recall': 0.7789647886093043, 'f1-score': 0.7880481905523563, 'support': 29334.0} | {'precision': 0.8421890541722198, 'recall': 0.842742210404309, 'f1-score': 0.8420460062860028, 'support': 29334.0} |
121
- | 0.0034 | 49.0 | 3969 | 1.2654 | {'precision': 0.5976983936705826, 'recall': 0.5849366494603473, 'f1-score': 0.5912486659551762, 'support': 4262.0} | {'precision': 0.8090117767537123, 'recall': 0.7297921478060047, 'f1-score': 0.7673627974745022, 'support': 2165.0} | {'precision': 0.9196736743018513, 'recall': 0.8910620186461289, 'f1-score': 0.9051417983426837, 'support': 9868.0} | {'precision': 0.8682687376364568, 'recall': 0.9088887184600046, 'f1-score': 0.8881145083932854, 'support': 13039.0} | 0.8426 | {'precision': 0.7986631455906508, 'recall': 0.7786698835931214, 'f1-score': 0.787966942541412, 'support': 29334.0} | {'precision': 0.841876216627403, 'recall': 0.8426058498670485, 'f1-score': 0.8417981390815746, 'support': 29334.0} |
122
- | 0.0031 | 50.0 | 4050 | 1.2704 | {'precision': 0.5972354623450906, 'recall': 0.5879868606288128, 'f1-score': 0.5925750768503193, 'support': 4262.0} | {'precision': 0.8091328886608518, 'recall': 0.7284064665127021, 'f1-score': 0.7666504618376278, 'support': 2165.0} | {'precision': 0.9211161229413616, 'recall': 0.8898459667612485, 'f1-score': 0.9052110715942477, 'support': 9868.0} | {'precision': 0.8676039835969537, 'recall': 0.9086586394662167, 'f1-score': 0.8876568645813823, 'support': 13039.0} | 0.8424 | {'precision': 0.7987721143860643, 'recall': 0.7787244833422451, 'f1-score': 0.7880233687158943, 'support': 29334.0} | {'precision': 0.8420076528182845, 'recall': 0.8424353991954728, 'f1-score': 0.8417581625139158, 'support': 29334.0} |
123
 
124
 
125
  ### Framework versions
 
17
  name: essays_su_g
18
  type: essays_su_g
19
  config: simple
20
+ split: train[20%:40%]
21
  args: simple
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
+ value: 0.8596357867600886
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 1.0920
36
+ - Claim: {'precision': 0.6182355616189177, 'recall': 0.6244832338079926, 'f1-score': 0.6213436928702011, 'support': 4354.0}
37
+ - Majorclaim: {'precision': 0.8, 'recall': 0.86504895700298, 'f1-score': 0.8312538351401105, 'support': 2349.0}
38
+ - O: {'precision': 0.9246820349761526, 'recall': 0.9141453831041257, 'f1-score': 0.919383521043272, 'support': 10180.0}
39
+ - Premise: {'precision': 0.9017729158807997, 'recall': 0.8937490653506804, 'f1-score': 0.8977430620751813, 'support': 13374.0}
40
+ - Accuracy: 0.8596
41
+ - Macro avg: {'precision': 0.8111726281189675, 'recall': 0.8243566598164448, 'f1-score': 0.8174310277821912, 'support': 30257.0}
42
+ - Weighted avg: {'precision': 0.8607783894085936, 'recall': 0.8596357867600886, 'f1-score': 0.8600881004037069, 'support': 30257.0}
43
 
44
  ## Model description
45
 
 
68
 
69
  ### Training results
70
 
71
+ | Training Loss | Epoch | Step | Validation Loss | Claim | Majorclaim | O | Premise | Accuracy | Macro avg | Weighted avg |
72
+ |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
73
+ | No log | 1.0 | 81 | 0.4783 | {'precision': 0.5477537437603993, 'recall': 0.3780431786862655, 'f1-score': 0.44734338904742493, 'support': 4354.0} | {'precision': 0.5898856944925528, 'recall': 0.7249893571732652, 'f1-score': 0.6504965622612681, 'support': 2349.0} | {'precision': 0.8689081979599547, 'recall': 0.9037328094302554, 'f1-score': 0.8859784283513097, 'support': 10180.0} | {'precision': 0.859258183929738, 'recall': 0.8851502916105877, 'f1-score': 0.8720120805863504, 'support': 13374.0} | 0.8060 | {'precision': 0.7164514550356611, 'recall': 0.7229789092250934, 'f1-score': 0.7139576150615883, 'support': 30257.0} | {'precision': 0.7967665566250599, 'recall': 0.8059953068711373, 'f1-score': 0.7984036588902531, 'support': 30257.0} |
74
+ | No log | 2.0 | 162 | 0.4242 | {'precision': 0.5281409891984082, 'recall': 0.6401010564997703, 'f1-score': 0.5787561000934482, 'support': 4354.0} | {'precision': 0.7017850892544627, 'recall': 0.8535547041294168, 'f1-score': 0.7702650787552824, 'support': 2349.0} | {'precision': 0.9206077681626081, 'recall': 0.8987229862475442, 'f1-score': 0.9095337508698677, 'support': 10180.0} | {'precision': 0.9162905211325401, 'recall': 0.8348287722446538, 'f1-score': 0.8736648538675224, 'support': 13374.0} | 0.8298 | {'precision': 0.7667060919370048, 'recall': 0.8068018797803463, 'f1-score': 0.7830549458965301, 'support': 30257.0} | {'precision': 0.8452350051608073, 'recall': 0.8297584030141786, 'f1-score': 0.8352680063880269, 'support': 30257.0} |
75
+ | No log | 3.0 | 243 | 0.4107 | {'precision': 0.5899245558530056, 'recall': 0.5567294441892513, 'f1-score': 0.5728465083303793, 'support': 4354.0} | {'precision': 0.8017699115044248, 'recall': 0.7713920817369093, 'f1-score': 0.7862876979822088, 'support': 2349.0} | {'precision': 0.9048168445341794, 'recall': 0.9244597249508841, 'f1-score': 0.914532821534425, 'support': 10180.0} | {'precision': 0.8843330614665975, 'recall': 0.8918049947659639, 'f1-score': 0.8880533114924986, 'support': 13374.0} | 0.8452 | {'precision': 0.7952110933395518, 'recall': 0.7860965614107521, 'f1-score': 0.7904300848348779, 'support': 30257.0} | {'precision': 0.8424495118392472, 'recall': 0.8452258981392735, 'f1-score': 0.8437033615676307, 'support': 30257.0} |
76
+ | No log | 4.0 | 324 | 0.4546 | {'precision': 0.5714596949891068, 'recall': 0.6024345429490124, 'f1-score': 0.5865384615384616, 'support': 4354.0} | {'precision': 0.7425589485890993, 'recall': 0.8177948063005535, 'f1-score': 0.7783630470016208, 'support': 2349.0} | {'precision': 0.9063411787589963, 'recall': 0.9154223968565816, 'f1-score': 0.9108591535529275, 'support': 10180.0} | {'precision': 0.9067823097358962, 'recall': 0.8677284282937042, 'f1-score': 0.8868256151612411, 'support': 13374.0} | 0.8417 | {'precision': 0.7817855330182747, 'recall': 0.8008450435999629, 'f1-score': 0.7906465693135627, 'support': 30257.0} | {'precision': 0.8456313015960876, 'recall': 0.8417225765938461, 'f1-score': 0.8432797441676475, 'support': 30257.0} |
77
+ | No log | 5.0 | 405 | 0.4870 | {'precision': 0.5985704403965875, 'recall': 0.5962333486449242, 'f1-score': 0.597399608790703, 'support': 4354.0} | {'precision': 0.7940298507462686, 'recall': 0.7926777352064709, 'f1-score': 0.7933532168726033, 'support': 2349.0} | {'precision': 0.9042862684251358, 'recall': 0.9160117878192534, 'f1-score': 0.9101112629318758, 'support': 10180.0} | {'precision': 0.8961019377214808, 'recall': 0.8886645730521908, 'f1-score': 0.8923677591320345, 'support': 13374.0} | 0.8483 | {'precision': 0.7982471243223681, 'recall': 0.7983968611807098, 'f1-score': 0.7983079619318041, 'support': 30257.0} | {'precision': 0.8481162489521332, 'recall': 0.848332617245596, 'f1-score': 0.8482045037639816, 'support': 30257.0} |
78
+ | No log | 6.0 | 486 | 0.5424 | {'precision': 0.5903745644599303, 'recall': 0.6226458429030777, 'f1-score': 0.6060809300245921, 'support': 4354.0} | {'precision': 0.7963286713286714, 'recall': 0.7756492124308216, 'f1-score': 0.7858529221479404, 'support': 2349.0} | {'precision': 0.9398504051527115, 'recall': 0.8887033398821218, 'f1-score': 0.9135615470059578, 'support': 10180.0} | {'precision': 0.88328121591157, 'recall': 0.908180050844923, 'f1-score': 0.895557603686636, 'support': 13374.0} | 0.8502 | {'precision': 0.8024587142132208, 'recall': 0.7987946115152361, 'f1-score': 0.8002632507162816, 'support': 30257.0} | {'precision': 0.8534139871324166, 'recall': 0.8502495290346036, 'f1-score': 0.8514422719925407, 'support': 30257.0} |
79
+ | 0.35 | 7.0 | 567 | 0.5764 | {'precision': 0.6054453161052146, 'recall': 0.6026642168121268, 'f1-score': 0.6040515653775324, 'support': 4354.0} | {'precision': 0.8051063829787234, 'recall': 0.8054491272882077, 'f1-score': 0.8052777186635455, 'support': 2349.0} | {'precision': 0.9315082331548641, 'recall': 0.9057956777996071, 'f1-score': 0.9184720354599332, 'support': 10180.0} | {'precision': 0.8810881965774463, 'recall': 0.9008524001794527, 'f1-score': 0.8908606921029282, 'support': 13374.0} | 0.8522 | {'precision': 0.8057870322040621, 'recall': 0.8036903555198486, 'f1-score': 0.8046655029009848, 'support': 30257.0} | {'precision': 0.8524880574571969, 'recall': 0.8521994910268698, 'f1-score': 0.8522343290465387, 'support': 30257.0} |
80
+ | 0.35 | 8.0 | 648 | 0.5955 | {'precision': 0.6227261400448543, 'recall': 0.5739549839228296, 'f1-score': 0.597346719254213, 'support': 4354.0} | {'precision': 0.7676845767298028, 'recall': 0.8454661558109834, 'f1-score': 0.8047001620745543, 'support': 2349.0} | {'precision': 0.9258769700050838, 'recall': 0.8944990176817289, 'f1-score': 0.9099175618286286, 'support': 10180.0} | {'precision': 0.8797569092750688, 'recall': 0.9092268580828473, 'f1-score': 0.8942491542873952, 'support': 13374.0} | 0.8511 | {'precision': 0.7990111490137024, 'recall': 0.8057867538745973, 'f1-score': 0.8015533993611977, 'support': 30257.0} | {'precision': 0.8495864475589161, 'recall': 0.8510757841160723, 'f1-score': 0.8498442431569896, 'support': 30257.0} |
81
+ | 0.35 | 9.0 | 729 | 0.5690 | {'precision': 0.6213075060532688, 'recall': 0.5893431327514929, 'f1-score': 0.6049033474776048, 'support': 4354.0} | {'precision': 0.8628731343283582, 'recall': 0.787569178373776, 'f1-score': 0.823503227242377, 'support': 2349.0} | {'precision': 0.9027672479150872, 'recall': 0.9357563850687622, 'f1-score': 0.9189658498938837, 'support': 10180.0} | {'precision': 0.8970292606656243, 'recall': 0.9008524001794527, 'f1-score': 0.8989367655288193, 'support': 13374.0} | 0.8590 | {'precision': 0.8209942872405847, 'recall': 0.803380274093371, 'f1-score': 0.8115772975356712, 'support': 30257.0} | {'precision': 0.8566315824374819, 'recall': 0.8589747826949136, 'f1-score': 0.8575077142417292, 'support': 30257.0} |
82
+ | 0.35 | 10.0 | 810 | 0.7088 | {'precision': 0.6071094480823199, 'recall': 0.5962333486449242, 'f1-score': 0.60162224797219, 'support': 4354.0} | {'precision': 0.8333333333333334, 'recall': 0.7939548744146445, 'f1-score': 0.8131676477000218, 'support': 2349.0} | {'precision': 0.9338801134062373, 'recall': 0.905992141453831, 'f1-score': 0.9197247706422018, 'support': 10180.0} | {'precision': 0.884834499170693, 'recall': 0.9174517720951099, 'f1-score': 0.9008479864909512, 'support': 13374.0} | 0.8578 | {'precision': 0.8147893484981459, 'recall': 0.8034080341521274, 'f1-score': 0.8088406632013413, 'support': 30257.0} | {'precision': 0.8573728619273148, 'recall': 0.8577849753775986, 'f1-score': 0.8573332851434664, 'support': 30257.0} |
83
+ | 0.35 | 11.0 | 891 | 0.7312 | {'precision': 0.6289498141263941, 'recall': 0.6217271474506201, 'f1-score': 0.6253176253176252, 'support': 4354.0} | {'precision': 0.7318996415770609, 'recall': 0.8693060876968923, 'f1-score': 0.7947071414672116, 'support': 2349.0} | {'precision': 0.9221171261823304, 'recall': 0.900196463654224, 'f1-score': 0.9110249527786062, 'support': 10180.0} | {'precision': 0.9047258979206049, 'recall': 0.8946463286974727, 'f1-score': 0.8996578818752584, 'support': 13374.0} | 0.8553 | {'precision': 0.7969231199515976, 'recall': 0.8214690068748023, 'f1-score': 0.8076769003596753, 'support': 30257.0} | {'precision': 0.857475501606145, 'recall': 0.8552731599299336, 'f1-score': 0.8558567785115953, 'support': 30257.0} |
84
+ | 0.35 | 12.0 | 972 | 0.7092 | {'precision': 0.6395321637426901, 'recall': 0.6279283417547084, 'f1-score': 0.633677135241627, 'support': 4354.0} | {'precision': 0.7931570762052877, 'recall': 0.8684546615581098, 'f1-score': 0.8290997764681975, 'support': 2349.0} | {'precision': 0.9196243203163619, 'recall': 0.9137524557956778, 'f1-score': 0.916678984971668, 'support': 10180.0} | {'precision': 0.905603610379842, 'recall': 0.9002542246149244, 'f1-score': 0.9029209944129889, 'support': 13374.0} | 0.8631 | {'precision': 0.8144792926610454, 'recall': 0.8275974209308551, 'f1-score': 0.8205942227736204, 'support': 30257.0} | {'precision': 0.8633032778855295, 'recall': 0.8631391083055161, 'f1-score': 0.8630744313070275, 'support': 30257.0} |
85
+ | 0.063 | 13.0 | 1053 | 0.7807 | {'precision': 0.6096321393998064, 'recall': 0.5785484611851172, 'f1-score': 0.5936837143530521, 'support': 4354.0} | {'precision': 0.821270962047661, 'recall': 0.7922520221370796, 'f1-score': 0.8065005417118094, 'support': 2349.0} | {'precision': 0.9242683294780247, 'recall': 0.9027504911591355, 'f1-score': 0.9133826964170352, 'support': 10180.0} | {'precision': 0.883730957171601, 'recall': 0.9195453865709585, 'f1-score': 0.901282521069989, 'support': 13374.0} | 0.8549 | {'precision': 0.8097255970242733, 'recall': 0.7982740902630727, 'f1-score': 0.8037123683879714, 'support': 30257.0} | {'precision': 0.8530777420132861, 'recall': 0.854942657897346, 'f1-score': 0.8537315976828396, 'support': 30257.0} |
86
+ | 0.063 | 14.0 | 1134 | 0.7879 | {'precision': 0.632554945054945, 'recall': 0.6345888837850253, 'f1-score': 0.6335702820454024, 'support': 4354.0} | {'precision': 0.816793893129771, 'recall': 0.8199233716475096, 'f1-score': 0.8183556405353729, 'support': 2349.0} | {'precision': 0.9107990314769976, 'recall': 0.9237721021611002, 'f1-score': 0.9172396976347231, 'support': 10180.0} | {'precision': 0.9039073148568832, 'recall': 0.8925527142216241, 'f1-score': 0.8981941309255079, 'support': 13374.0} | 0.8603 | {'precision': 0.8160137961296492, 'recall': 0.8177092679538147, 'f1-score': 0.8168399377852517, 'support': 30257.0} | {'precision': 0.8604152313535001, 'recall': 0.8602967908252636, 'f1-score': 0.8603242501425289, 'support': 30257.0} |
87
+ | 0.063 | 15.0 | 1215 | 0.8185 | {'precision': 0.5828134433487623, 'recall': 0.6651355075792375, 'f1-score': 0.6212592513139547, 'support': 4354.0} | {'precision': 0.7765273311897106, 'recall': 0.822477650063857, 'f1-score': 0.7988422575976845, 'support': 2349.0} | {'precision': 0.9276255938542404, 'recall': 0.9014734774066797, 'f1-score': 0.9143625765954267, 'support': 10180.0} | {'precision': 0.9090416053304409, 'recall': 0.8772992373261552, 'f1-score': 0.8928883984627678, 'support': 13374.0} | 0.8506 | {'precision': 0.7990019934307886, 'recall': 0.8165964680939823, 'f1-score': 0.8068381209924584, 'support': 30257.0} | {'precision': 0.8580620487302317, 'recall': 0.8506461314737086, 'f1-score': 0.8537245501570023, 'support': 30257.0} |
88
+ | 0.063 | 16.0 | 1296 | 0.8933 | {'precision': 0.5878725590955807, 'recall': 0.6568672485071199, 'f1-score': 0.620457750298297, 'support': 4354.0} | {'precision': 0.7911741528762806, 'recall': 0.8548318433375904, 'f1-score': 0.8217720482913852, 'support': 2349.0} | {'precision': 0.9427445285758739, 'recall': 0.8928290766208251, 'f1-score': 0.9171081176529942, 'support': 10180.0} | {'precision': 0.900703852266707, 'recall': 0.8898609241812472, 'f1-score': 0.8952495580546884, 'support': 13374.0} | 0.8546 | {'precision': 0.8056237732036106, 'recall': 0.8235972731616956, 'f1-score': 0.8136468685743412, 'support': 30257.0} | {'precision': 0.8613285464033407, 'recall': 0.8546121558647586, 'f1-score': 0.8573567707758909, 'support': 30257.0} |
89
+ | 0.063 | 17.0 | 1377 | 0.8753 | {'precision': 0.6926782273603083, 'recall': 0.49540652273771246, 'f1-score': 0.577664702731655, 'support': 4354.0} | {'precision': 0.7783269961977186, 'recall': 0.8714346530438485, 'f1-score': 0.8222534645511148, 'support': 2349.0} | {'precision': 0.9185462424899045, 'recall': 0.9161100196463654, 'f1-score': 0.9173265135494024, 'support': 10180.0} | {'precision': 0.8705431754874652, 'recall': 0.9347240915208613, 'f1-score': 0.901492752578063, 'support': 13374.0} | 0.8603 | {'precision': 0.8150236603838491, 'recall': 0.8044188217371968, 'f1-score': 0.8046843583525589, 'support': 30257.0} | {'precision': 0.8539397922302876, 'recall': 0.8603298410285223, 'f1-score': 0.8540692561997597, 'support': 30257.0} |
90
+ | 0.063 | 18.0 | 1458 | 0.9685 | {'precision': 0.5981667021956939, 'recall': 0.6444648598989435, 'f1-score': 0.6204532891100056, 'support': 4354.0} | {'precision': 0.807372175980975, 'recall': 0.8671775223499362, 'f1-score': 0.8362068965517241, 'support': 2349.0} | {'precision': 0.8936068244991853, 'recall': 0.9158153241650294, 'f1-score': 0.9045747829039926, 'support': 10180.0} | {'precision': 0.9118953211736717, 'recall': 0.8598026020637057, 'f1-score': 0.8850831280788178, 'support': 13374.0} | 0.8482 | {'precision': 0.8027602559623814, 'recall': 0.8218150771194037, 'f1-score': 0.811579524161135, 'support': 30257.0} | {'precision': 0.8524817583209754, 'recall': 0.8482334666358198, 'f1-score': 0.8497662248627994, 'support': 30257.0} |
91
+ | 0.0216 | 19.0 | 1539 | 0.9391 | {'precision': 0.5946462715105163, 'recall': 0.6428571428571429, 'f1-score': 0.6178126034654013, 'support': 4354.0} | {'precision': 0.7575868372943327, 'recall': 0.8820774797786292, 'f1-score': 0.8151062155782848, 'support': 2349.0} | {'precision': 0.9213595136051032, 'recall': 0.9080550098231827, 'f1-score': 0.9146588828971454, 'support': 10180.0} | {'precision': 0.9104991394148021, 'recall': 0.870195902497383, 'f1-score': 0.8898914207065302, 'support': 13374.0} | 0.8511 | {'precision': 0.7960229404561886, 'recall': 0.8257963837390844, 'f1-score': 0.8093672806618404, 'support': 30257.0} | {'precision': 0.8568303759789367, 'recall': 0.8511418845225898, 'f1-score': 0.853266214902463, 'support': 30257.0} |
92
+ | 0.0216 | 20.0 | 1620 | 0.8916 | {'precision': 0.6064530788457169, 'recall': 0.6129995406522738, 'f1-score': 0.6097087378640776, 'support': 4354.0} | {'precision': 0.7802114803625377, 'recall': 0.8795232013622818, 'f1-score': 0.8268961376826096, 'support': 2349.0} | {'precision': 0.9370494466443293, 'recall': 0.906581532416503, 'f1-score': 0.9215637325877477, 'support': 10180.0} | {'precision': 0.8971479901190209, 'recall': 0.8961417676087932, 'f1-score': 0.896644596566042, 'support': 13374.0} | 0.8576 | {'precision': 0.8052154989929012, 'recall': 0.8238115105099629, 'f1-score': 0.8137033011751192, 'support': 30257.0} | {'precision': 0.8596633525913644, 'recall': 0.8576197243613048, 'f1-score': 0.8583235120565212, 'support': 30257.0} |
93
+ | 0.0216 | 21.0 | 1701 | 0.9741 | {'precision': 0.5754014884449667, 'recall': 0.6747818098300413, 'f1-score': 0.6211416490486258, 'support': 4354.0} | {'precision': 0.7965964343598055, 'recall': 0.8369518944231588, 'f1-score': 0.8162756902636495, 'support': 2349.0} | {'precision': 0.9325935059597205, 'recall': 0.8915520628683693, 'f1-score': 0.911611088790679, 'support': 10180.0} | {'precision': 0.9030190718863408, 'recall': 0.8744579033946464, 'f1-score': 0.8885090218423553, 'support': 13374.0} | 0.8486 | {'precision': 0.8019026251627084, 'recall': 0.8194359176290539, 'f1-score': 0.8093843624863275, 'support': 30257.0} | {'precision': 0.8575629461968616, 'recall': 0.8485639686684073, 'f1-score': 0.852199586158436, 'support': 30257.0} |
94
+ | 0.0216 | 22.0 | 1782 | 0.9676 | {'precision': 0.6028274795670422, 'recall': 0.6267799724391364, 'f1-score': 0.6145704312577412, 'support': 4354.0} | {'precision': 0.784251968503937, 'recall': 0.8480204342273308, 'f1-score': 0.8148905706688483, 'support': 2349.0} | {'precision': 0.9137847053093034, 'recall': 0.9214145383104125, 'f1-score': 0.9175837613108339, 'support': 10180.0} | {'precision': 0.9070019342359767, 'recall': 0.876551517870495, 'f1-score': 0.8915167877105593, 'support': 13374.0} | 0.8535 | {'precision': 0.8019665219040648, 'recall': 0.8181916157118437, 'f1-score': 0.8096403877369956, 'support': 30257.0} | {'precision': 0.8559834381654265, 'recall': 0.853488448953961, 'f1-score': 0.8544854353433136, 'support': 30257.0} |
95
+ | 0.0216 | 23.0 | 1863 | 0.9898 | {'precision': 0.6113108075724898, 'recall': 0.5858980248047773, 'f1-score': 0.5983347015362965, 'support': 4354.0} | {'precision': 0.8553230209281165, 'recall': 0.800340570455513, 'f1-score': 0.8269188475918188, 'support': 2349.0} | {'precision': 0.9227514268844715, 'recall': 0.9211198428290767, 'f1-score': 0.9219349129879069, 'support': 10180.0} | {'precision': 0.8835616438356164, 'recall': 0.9066846119336025, 'f1-score': 0.8949737988043397, 'support': 13374.0} | 0.8571 | {'precision': 0.8182367248051736, 'recall': 0.8035107625057423, 'f1-score': 0.8105405652300904, 'support': 30257.0} | {'precision': 0.8553777302003576, 'recall': 0.8571239713124236, 'f1-score': 0.8560749136698399, 'support': 30257.0} |
96
+ | 0.0216 | 24.0 | 1944 | 0.9720 | {'precision': 0.6016132646202106, 'recall': 0.6166743224621039, 'f1-score': 0.6090506975161619, 'support': 4354.0} | {'precision': 0.7454477889260498, 'recall': 0.853980417198808, 'f1-score': 0.7960317460317461, 'support': 2349.0} | {'precision': 0.9310592091784471, 'recall': 0.8928290766208251, 'f1-score': 0.9115434760806339, 'support': 10180.0} | {'precision': 0.9006821077880219, 'recall': 0.89845969792134, 'f1-score': 0.8995695302264645, 'support': 13374.0} | 0.8526 | {'precision': 0.7947005926281823, 'recall': 0.8154858785507693, 'f1-score': 0.8040488624637516, 'support': 30257.0} | {'precision': 0.8558147294621835, 'recall': 0.852563043262716, 'f1-score': 0.8537541987693271, 'support': 30257.0} |
97
+ | 0.0116 | 25.0 | 2025 | 1.0132 | {'precision': 0.6326429980276134, 'recall': 0.5893431327514929, 'f1-score': 0.6102259215219976, 'support': 4354.0} | {'precision': 0.8006714225765842, 'recall': 0.8122605363984674, 'f1-score': 0.8064243448858834, 'support': 2349.0} | {'precision': 0.9298989898989899, 'recall': 0.9043222003929273, 'f1-score': 0.9169322709163347, 'support': 10180.0} | {'precision': 0.8818077309958328, 'recall': 0.917676087931808, 'f1-score': 0.8993844349992672, 'support': 13374.0} | 0.8578 | {'precision': 0.811255285374755, 'recall': 0.8059004893686739, 'f1-score': 0.8082417430808707, 'support': 30257.0} | {'precision': 0.8558341242209939, 'recall': 0.8577519251743398, 'f1-score': 0.8564613940592988, 'support': 30257.0} |
98
+ | 0.0116 | 26.0 | 2106 | 1.0290 | {'precision': 0.6006185111552905, 'recall': 0.6244832338079926, 'f1-score': 0.6123184326089406, 'support': 4354.0} | {'precision': 0.8013876843018214, 'recall': 0.7867177522349936, 'f1-score': 0.7939849624060151, 'support': 2349.0} | {'precision': 0.93204469948656, 'recall': 0.9094302554027505, 'f1-score': 0.9205986178093769, 'support': 10180.0} | {'precision': 0.8957082499444073, 'recall': 0.9035441902198296, 'f1-score': 0.8996091568955891, 'support': 13374.0} | 0.8563 | {'precision': 0.8074397862220198, 'recall': 0.8060438579163915, 'f1-score': 0.8066277924299805, 'support': 30257.0} | {'precision': 0.8581475309358099, 'recall': 0.8562977162309549, 'f1-score': 0.8571296534981037, 'support': 30257.0} |
99
+ | 0.0116 | 27.0 | 2187 | 1.0471 | {'precision': 0.6480063374702931, 'recall': 0.5636196600826826, 'f1-score': 0.6028743397617001, 'support': 4354.0} | {'precision': 0.8347863993025283, 'recall': 0.8152405278842061, 'f1-score': 0.8248976954555244, 'support': 2349.0} | {'precision': 0.9111240197502178, 'recall': 0.9244597249508841, 'f1-score': 0.9177434297137843, 'support': 10180.0} | {'precision': 0.883512674225464, 'recall': 0.9147599820547331, 'f1-score': 0.8988648469931302, 'support': 13374.0} | 0.8598 | {'precision': 0.8193573576871258, 'recall': 0.8045199737431264, 'f1-score': 0.8110950779810349, 'support': 30257.0} | {'precision': 0.8551301805022264, 'recall': 0.8597679875731236, 'f1-score': 0.8568809247486504, 'support': 30257.0} |
100
+ | 0.0116 | 28.0 | 2268 | 1.0588 | {'precision': 0.6152253909843606, 'recall': 0.6143775838309601, 'f1-score': 0.6148011951275568, 'support': 4354.0} | {'precision': 0.7258282623394186, 'recall': 0.9140059599829715, 'f1-score': 0.80912003014886, 'support': 2349.0} | {'precision': 0.9418216001671192, 'recall': 0.8857563850687623, 'f1-score': 0.9129290270324997, 'support': 10180.0} | {'precision': 0.8978844284966734, 'recall': 0.8980858381935098, 'f1-score': 0.897985122051512, 'support': 13374.0} | 0.8543 | {'precision': 0.7951899204968929, 'recall': 0.8280564417690509, 'f1-score': 0.8087088435901071, 'support': 30257.0} | {'precision': 0.8586347680535737, 'recall': 0.8543477542386886, 'f1-score': 0.8553636471531488, 'support': 30257.0} |
101
+ | 0.0116 | 29.0 | 2349 | 1.0133 | {'precision': 0.6220508166969148, 'recall': 0.6297657326596233, 'f1-score': 0.6258845012554212, 'support': 4354.0} | {'precision': 0.7991071428571429, 'recall': 0.8382290336313325, 'f1-score': 0.8182007064201122, 'support': 2349.0} | {'precision': 0.9275189167662286, 'recall': 0.9151277013752456, 'f1-score': 0.9212816455696202, 'support': 10180.0} | {'precision': 0.8988831421932388, 'recall': 0.8966651712277554, 'f1-score': 0.8977727868238817, 'support': 13374.0} | 0.8599 | {'precision': 0.8118900046283812, 'recall': 0.8199469097234893, 'f1-score': 0.8157849100172588, 'support': 30257.0} | {'precision': 0.8609352431120858, 'recall': 0.8599332385894173, 'f1-score': 0.860379911449525, 'support': 30257.0} |
102
+ | 0.0116 | 30.0 | 2430 | 1.0924 | {'precision': 0.5691448382126348, 'recall': 0.6786862655029857, 'f1-score': 0.6191074795725958, 'support': 4354.0} | {'precision': 0.7735177865612648, 'recall': 0.8331204767986378, 'f1-score': 0.802213568354171, 'support': 2349.0} | {'precision': 0.9313517338995047, 'recall': 0.9049115913555992, 'f1-score': 0.9179413083553385, 'support': 10180.0} | {'precision': 0.9156912369503322, 'recall': 0.8657095857634216, 'f1-score': 0.8899992313014068, 'support': 13374.0} | 0.8495 | {'precision': 0.797426398905934, 'recall': 0.8206069798551611, 'f1-score': 0.8073153968958781, 'support': 30257.0} | {'precision': 0.8600543728816776, 'recall': 0.8494563241563936, 'f1-score': 0.853603657884304, 'support': 30257.0} |
103
+ | 0.0059 | 31.0 | 2511 | 1.0502 | {'precision': 0.5720296533760769, 'recall': 0.655718879191548, 'f1-score': 0.6110219368646335, 'support': 4354.0} | {'precision': 0.7757296466973886, 'recall': 0.8599404001702853, 'f1-score': 0.8156672723601858, 'support': 2349.0} | {'precision': 0.9318525996971226, 'recall': 0.906679764243615, 'f1-score': 0.9190938511326862, 'support': 10180.0} | {'precision': 0.9120482872148624, 'recall': 0.8699715866606849, 'f1-score': 0.890513183575064, 'support': 13374.0} | 0.8507 | {'precision': 0.7979150467463627, 'recall': 0.8230776575665333, 'f1-score': 0.8090740609831424, 'support': 30257.0} | {'precision': 0.8591995012400396, 'recall': 0.850712231880226, 'f1-score': 0.8540995689442556, 'support': 30257.0} |
104
+ | 0.0059 | 32.0 | 2592 | 1.0192 | {'precision': 0.6272174353775976, 'recall': 0.5684428112080845, 'f1-score': 0.5963855421686747, 'support': 4354.0} | {'precision': 0.8004073319755601, 'recall': 0.8365261813537676, 'f1-score': 0.8180682764363031, 'support': 2349.0} | {'precision': 0.9323861346231358, 'recall': 0.9089390962671906, 'f1-score': 0.9205133306804616, 'support': 10180.0} | {'precision': 0.8845822566752799, 'recall': 0.9214894571556752, 'f1-score': 0.9026587563172929, 'support': 13374.0} | 0.8599 | {'precision': 0.8111482896628934, 'recall': 0.8088493864961794, 'f1-score': 0.8094064764006831, 'support': 30257.0} | {'precision': 0.8570960600087044, 'recall': 0.8598671381828998, 'f1-score': 0.8580258765001771, 'support': 30257.0} |
105
+ | 0.0059 | 33.0 | 2673 | 1.0604 | {'precision': 0.618805002315887, 'recall': 0.6136885622416169, 'f1-score': 0.6162361623616236, 'support': 4354.0} | {'precision': 0.8121931260229133, 'recall': 0.8450404427415922, 'f1-score': 0.8282912580847068, 'support': 2349.0} | {'precision': 0.9235939507759218, 'recall': 0.9178781925343812, 'f1-score': 0.9207272010641968, 'support': 10180.0} | {'precision': 0.8986395574824338, 'recall': 0.8989083295947361, 'f1-score': 0.8987739234449761, 'support': 13374.0} | 0.8601 | {'precision': 0.813307909149289, 'recall': 0.8188788817780815, 'f1-score': 0.8160071362388759, 'support': 30257.0} | {'precision': 0.8600558711630416, 'recall': 0.8600654394024523, 'f1-score': 0.8600308614585094, 'support': 30257.0} |
106
+ | 0.0059 | 34.0 | 2754 | 1.0024 | {'precision': 0.5991000642811227, 'recall': 0.6421681212677998, 'f1-score': 0.6198869304955105, 'support': 4354.0} | {'precision': 0.7872755659640905, 'recall': 0.8586632609621115, 'f1-score': 0.8214212991244145, 'support': 2349.0} | {'precision': 0.9350253807106599, 'recall': 0.9047151277013753, 'f1-score': 0.9196205691462807, 'support': 10180.0} | {'precision': 0.9040825618455001, 'recall': 0.8908329594736055, 'f1-score': 0.897408858089786, 'support': 13374.0} | 0.8572 | {'precision': 0.8063708932003434, 'recall': 0.8240948673512231, 'f1-score': 0.8145844142139979, 'support': 30257.0} | {'precision': 0.8615378438736785, 'recall': 0.8572231219221998, 'f1-score': 0.8590471556672056, 'support': 30257.0} |
107
+ | 0.0059 | 35.0 | 2835 | 1.0053 | {'precision': 0.6278301886792453, 'recall': 0.6113918236104732, 'f1-score': 0.6195019781242729, 'support': 4354.0} | {'precision': 0.8007920792079208, 'recall': 0.8607918263090677, 'f1-score': 0.8297086581862947, 'support': 2349.0} | {'precision': 0.9243473101265823, 'recall': 0.9181728880157171, 'f1-score': 0.9212497535974769, 'support': 10180.0} | {'precision': 0.8998505231689088, 'recall': 0.9002542246149244, 'f1-score': 0.9000523286237572, 'support': 13374.0} | 0.8617 | {'precision': 0.8132050252956643, 'recall': 0.8226526906375455, 'f1-score': 0.8176281796329504, 'support': 30257.0} | {'precision': 0.8612582129595939, 'recall': 0.8616518491588723, 'f1-score': 0.8613517396129535, 'support': 30257.0} |
108
+ | 0.0059 | 36.0 | 2916 | 1.0221 | {'precision': 0.6272617611580217, 'recall': 0.5971520440973818, 'f1-score': 0.6118366866690199, 'support': 4354.0} | {'precision': 0.8109656301145662, 'recall': 0.8437633035334184, 'f1-score': 0.8270394325057375, 'support': 2349.0} | {'precision': 0.9288135593220339, 'recall': 0.9151277013752456, 'f1-score': 0.9219198416625434, 'support': 10180.0} | {'precision': 0.8907464437600822, 'recall': 0.908329594736055, 'f1-score': 0.8994520953650229, 'support': 13374.0} | 0.8608 | {'precision': 0.814446848588676, 'recall': 0.8160931609355251, 'f1-score': 0.8150620140505809, 'support': 30257.0} | {'precision': 0.8594447878496476, 'recall': 0.8608255940774036, 'f1-score': 0.8600016152377763, 'support': 30257.0} |
109
+ | 0.0059 | 37.0 | 2997 | 1.0784 | {'precision': 0.6126709863210943, 'recall': 0.586357372531006, 'f1-score': 0.5992254430231193, 'support': 4354.0} | {'precision': 0.7829153605015674, 'recall': 0.8505747126436781, 'f1-score': 0.8153438073862477, 'support': 2349.0} | {'precision': 0.928993490235353, 'recall': 0.9111984282907662, 'f1-score': 0.9200099181750558, 'support': 10180.0} | {'precision': 0.8924223419169187, 'recall': 0.9043666816210558, 'f1-score': 0.8983548111560886, 'support': 13374.0} | 0.8567 | {'precision': 0.8042505447437334, 'recall': 0.8131242987716265, 'f1-score': 0.8082334949351277, 'support': 30257.0} | {'precision': 0.855968793590012, 'recall': 0.8567273688733186, 'f1-score': 0.8561512507484733, 'support': 30257.0} |
110
+ | 0.0056 | 38.0 | 3078 | 1.0627 | {'precision': 0.6600834492350487, 'recall': 0.545016077170418, 'f1-score': 0.5970562334884891, 'support': 4354.0} | {'precision': 0.7832877782116361, 'recall': 0.853980417198808, 'f1-score': 0.8171079429735234, 'support': 2349.0} | {'precision': 0.9168210628961482, 'recall': 0.9235756385068762, 'f1-score': 0.9201859554685589, 'support': 10180.0} | {'precision': 0.886320959121768, 'recall': 0.917601315986242, 'f1-score': 0.9016899338721528, 'support': 13374.0} | 0.8611 | {'precision': 0.8116283123661503, 'recall': 0.810043362215586, 'f1-score': 0.809010016450681, 'support': 30257.0} | {'precision': 0.8560280681021202, 'recall': 0.8610569455002148, 'f1-score': 0.857509455693882, 'support': 30257.0} |
111
+ | 0.0056 | 39.0 | 3159 | 1.0807 | {'precision': 0.6121442975576966, 'recall': 0.6274689940284796, 'f1-score': 0.6197119201542475, 'support': 4354.0} | {'precision': 0.7752365930599369, 'recall': 0.8369518944231588, 'f1-score': 0.8049129989764585, 'support': 2349.0} | {'precision': 0.9239475774424146, 'recall': 0.9141453831041257, 'f1-score': 0.9190203436697609, 'support': 10180.0} | {'precision': 0.9063400576368876, 'recall': 0.8935995214595484, 'f1-score': 0.8999246987951808, 'support': 13374.0} | 0.8578 | {'precision': 0.8044171314242339, 'recall': 0.8180414482538281, 'f1-score': 0.8108924903989119, 'support': 30257.0} | {'precision': 0.8597509765628951, 'recall': 0.8578180255808573, 'f1-score': 0.8586504397393069, 'support': 30257.0} |
112
+ | 0.0056 | 40.0 | 3240 | 1.0857 | {'precision': 0.6403553299492386, 'recall': 0.5794671566375746, 'f1-score': 0.6083916083916084, 'support': 4354.0} | {'precision': 0.7841639871382636, 'recall': 0.8305661983822903, 'f1-score': 0.806698366756254, 'support': 2349.0} | {'precision': 0.9327577450482478, 'recall': 0.9020628683693517, 'f1-score': 0.9171535580524344, 'support': 10180.0} | {'precision': 0.8838672768878718, 'recall': 0.924181247196052, 'f1-score': 0.9035748227209591, 'support': 13374.0} | 0.8599 | {'precision': 0.8102860847559054, 'recall': 0.8090693676463172, 'f1-score': 0.808954588980314, 'support': 30257.0} | {'precision': 0.8575345578899536, 'recall': 0.8598671381828998, 'f1-score': 0.8581453688895593, 'support': 30257.0} |
113
+ | 0.0056 | 41.0 | 3321 | 1.0827 | {'precision': 0.616471099521947, 'recall': 0.6515847496554892, 'f1-score': 0.633541759714158, 'support': 4354.0} | {'precision': 0.7827640984908658, 'recall': 0.8390804597701149, 'f1-score': 0.8099445243476474, 'support': 2349.0} | {'precision': 0.9238968024703655, 'recall': 0.9111001964636543, 'f1-score': 0.9174538800138484, 'support': 10180.0} | {'precision': 0.907924874026569, 'recall': 0.889187976671153, 'f1-score': 0.8984587488667273, 'support': 13374.0} | 0.8585 | {'precision': 0.8077642186274367, 'recall': 0.8227383456401028, 'f1-score': 0.8148497282355953, 'support': 30257.0} | {'precision': 0.8616414300510049, 'recall': 0.8584790296460323, 'f1-score': 0.8598561759385482, 'support': 30257.0} |
114
+ | 0.0056 | 42.0 | 3402 | 1.1027 | {'precision': 0.6000876040297853, 'recall': 0.6293063849333945, 'f1-score': 0.6143497757847534, 'support': 4354.0} | {'precision': 0.7960687960687961, 'recall': 0.8275862068965517, 'f1-score': 0.8115216030056356, 'support': 2349.0} | {'precision': 0.9348998067338012, 'recall': 0.9028487229862475, 'f1-score': 0.9185947728749189, 'support': 10180.0} | {'precision': 0.8968549709345655, 'recall': 0.8998055929415283, 'f1-score': 0.8983278590624066, 'support': 13374.0} | 0.8563 | {'precision': 0.806977794441737, 'recall': 0.8148867269394304, 'f1-score': 0.8106985026819286, 'support': 30257.0} | {'precision': 0.8591256715384956, 'recall': 0.8562977162309549, 'f1-score': 0.8575428741842996, 'support': 30257.0} |
115
+ | 0.0056 | 43.0 | 3483 | 1.0912 | {'precision': 0.6053575195106518, 'recall': 0.6591639871382636, 'f1-score': 0.6311159978009895, 'support': 4354.0} | {'precision': 0.8087291399229781, 'recall': 0.8045977011494253, 'f1-score': 0.8066581306017925, 'support': 2349.0} | {'precision': 0.9296835760924159, 'recall': 0.9091355599214146, 'f1-score': 0.9192947603675194, 'support': 10180.0} | {'precision': 0.904794313369631, 'recall': 0.8946463286974727, 'f1-score': 0.8996917061433192, 'support': 13374.0} | 0.8586 | {'precision': 0.8121411372239192, 'recall': 0.816885894226644, 'f1-score': 0.8141901487284051, 'support': 30257.0} | {'precision': 0.8626211898487851, 'recall': 0.8586442806623261, 'f1-score': 0.8604163182639131, 'support': 30257.0} |
116
+ | 0.0038 | 44.0 | 3564 | 1.0970 | {'precision': 0.6089013115459041, 'recall': 0.6504363803399174, 'f1-score': 0.6289838978345363, 'support': 4354.0} | {'precision': 0.7846758349705305, 'recall': 0.8501489995742869, 'f1-score': 0.8161013485901104, 'support': 2349.0} | {'precision': 0.9292533413727263, 'recall': 0.9083497053045186, 'f1-score': 0.9186826287814813, 'support': 10180.0} | {'precision': 0.9074752097635392, 'recall': 0.8895618363989831, 'f1-score': 0.8984292402960278, 'support': 13374.0} | 0.8584 | {'precision': 0.807576424413175, 'recall': 0.8246242304044265, 'f1-score': 0.815549278875539, 'support': 30257.0} | {'precision': 0.8623040062586698, 'recall': 0.8584129292395148, 'f1-score': 0.860078652203599, 'support': 30257.0} |
117
+ | 0.0038 | 45.0 | 3645 | 1.0909 | {'precision': 0.6125760649087221, 'recall': 0.6242535599448783, 'f1-score': 0.6183596860425435, 'support': 4354.0} | {'precision': 0.8168358714043993, 'recall': 0.8220519369944658, 'f1-score': 0.8194356036494802, 'support': 2349.0} | {'precision': 0.9284640817553351, 'recall': 0.9103143418467583, 'f1-score': 0.9192996379147859, 'support': 10180.0} | {'precision': 0.8955844155844156, 'recall': 0.9023478390907731, 'f1-score': 0.8989534060858877, 'support': 13374.0} | 0.8588 | {'precision': 0.813365108413218, 'recall': 0.8147419194692188, 'f1-score': 0.8140120834231743, 'support': 30257.0} | {'precision': 0.8598081096882307, 'recall': 0.8587764814753611, 'f1-score': 0.8592479582565041, 'support': 30257.0} |
118
+ | 0.0038 | 46.0 | 3726 | 1.0958 | {'precision': 0.613838242169238, 'recall': 0.6031235645383556, 'f1-score': 0.6084337349397592, 'support': 4354.0} | {'precision': 0.7956, 'recall': 0.8467432950191571, 'f1-score': 0.8203753351206435, 'support': 2349.0} | {'precision': 0.9285857572718155, 'recall': 0.9094302554027505, 'f1-score': 0.918908188585608, 'support': 10180.0} | {'precision': 0.8941446443111999, 'recall': 0.9031703304919994, 'f1-score': 0.8986348249823308, 'support': 13374.0} | 0.8577 | {'precision': 0.8080421609380632, 'recall': 0.8156168613630657, 'f1-score': 0.8115880209070854, 'support': 30257.0} | {'precision': 0.8577456320339072, 'recall': 0.8577188749710811, 'f1-score': 0.8576200434028913, 'support': 30257.0} |
119
+ | 0.0038 | 47.0 | 3807 | 1.0941 | {'precision': 0.6171088746569076, 'recall': 0.6196600826825908, 'f1-score': 0.6183818473527389, 'support': 4354.0} | {'precision': 0.7963466770307035, 'recall': 0.8722860791826309, 'f1-score': 0.8325883787078424, 'support': 2349.0} | {'precision': 0.9271238893880404, 'recall': 0.9122789783889981, 'f1-score': 0.9196415309204337, 'support': 10180.0} | {'precision': 0.8996615268898082, 'recall': 0.8943472409152086, 'f1-score': 0.8969965128051295, 'support': 13374.0} | 0.8591 | {'precision': 0.810060241991365, 'recall': 0.824643095292357, 'f1-score': 0.8169020674465362, 'support': 30257.0} | {'precision': 0.8602209352941748, 'recall': 0.8591400337112073, 'f1-score': 0.8595223191983462, 'support': 30257.0} |
120
+ | 0.0038 | 48.0 | 3888 | 1.0953 | {'precision': 0.6142533936651584, 'recall': 0.6235645383555352, 'f1-score': 0.6188739457488033, 'support': 4354.0} | {'precision': 0.7976516634050881, 'recall': 0.8676032354193274, 'f1-score': 0.8311582381729201, 'support': 2349.0} | {'precision': 0.9256420465857057, 'recall': 0.9134577603143419, 'f1-score': 0.91950954217344, 'support': 10180.0} | {'precision': 0.9016319129646418, 'recall': 0.892328398384926, 'f1-score': 0.89695603156708, 'support': 13374.0} | 0.8588 | {'precision': 0.8097947541551485, 'recall': 0.8242384831185325, 'f1-score': 0.8166244394155608, 'support': 30257.0} | {'precision': 0.8602837119208202, 'recall': 0.8588425818818786, 'f1-score': 0.8594198025832774, 'support': 30257.0} |
121
+ | 0.0038 | 49.0 | 3969 | 1.0902 | {'precision': 0.6190804597701149, 'recall': 0.6185117133670188, 'f1-score': 0.6187959558823529, 'support': 4354.0} | {'precision': 0.7996062992125984, 'recall': 0.8646232439335888, 'f1-score': 0.8308447535283289, 'support': 2349.0} | {'precision': 0.9244590033750248, 'recall': 0.9148330058939096, 'f1-score': 0.9196208156413548, 'support': 10180.0} | {'precision': 0.9003987060859099, 'recall': 0.8949454164797368, 'f1-score': 0.8976637792027601, 'support': 13374.0} | 0.8595 | {'precision': 0.810886117110912, 'recall': 0.8232283449185636, 'f1-score': 0.8167313260636991, 'support': 30257.0} | {'precision': 0.8601869474250647, 'recall': 0.8595035859470536, 'f1-score': 0.8597345144672809, 'support': 30257.0} |
122
+ | 0.0031 | 50.0 | 4050 | 1.0920 | {'precision': 0.6182355616189177, 'recall': 0.6244832338079926, 'f1-score': 0.6213436928702011, 'support': 4354.0} | {'precision': 0.8, 'recall': 0.86504895700298, 'f1-score': 0.8312538351401105, 'support': 2349.0} | {'precision': 0.9246820349761526, 'recall': 0.9141453831041257, 'f1-score': 0.919383521043272, 'support': 10180.0} | {'precision': 0.9017729158807997, 'recall': 0.8937490653506804, 'f1-score': 0.8977430620751813, 'support': 13374.0} | 0.8596 | {'precision': 0.8111726281189675, 'recall': 0.8243566598164448, 'f1-score': 0.8174310277821912, 'support': 30257.0} | {'precision': 0.8607783894085936, 'recall': 0.8596357867600886, 'f1-score': 0.8600881004037069, 'support': 30257.0} |
123
 
124
 
125
  ### Framework versions