Hugging Face's logo

haryoaw
/
scenario-kd-scr-ner-full-mdeberta_data-univner_full55

Transformers
Safetensors
deberta-v2
Generated from Trainer
Inference Endpoints
Model card Files Community
haryoaw commited on
Commit
b747363
•
1 Parent(s): 11a8635

Initial Commit

Browse files
Files changed (4) hide show
  1. README.md +44 -31
  2. eval_result_ner.json +1 -1
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -1,14 +1,14 @@
1
  ---
2
- base_model: haryoaw/scenario-TCR-NER_data-univner_full
3
  library_name: transformers
4
  license: mit
 
 
 
5
  metrics:
6
  - precision
7
  - recall
8
  - f1
9
  - accuracy
10
- tags:
11
- - generated_from_trainer
12
  model-index:
13
  - name: scenario-kd-scr-ner-full-mdeberta_data-univner_full55
14
  results: []
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model is a fine-tuned version of [haryoaw/scenario-TCR-NER_data-univner_full](https://huggingface.co/haryoaw/scenario-TCR-NER_data-univner_full) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: nan
25
- - Precision: 0.0
26
- - Recall: 0.0
27
- - F1: 0.0
28
- - Accuracy: 0.9241
29
 
30
  ## Model description
31
 
@@ -56,29 +56,42 @@ The following hyperparameters were used during training:
56
 
57
  ### Training results
58
 
59
- | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
60
- |:-------------:|:------:|:-----:|:---------------:|:---------:|:------:|:---:|:--------:|
61
- | 72900804.608 | 0.2911 | 500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
62
- | 0.0 | 0.5822 | 1000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
63
- | 0.0 | 0.8732 | 1500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
64
- | 0.0 | 1.1643 | 2000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
65
- | 0.0 | 1.4554 | 2500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
66
- | 0.0 | 1.7465 | 3000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
67
- | 0.0 | 2.0375 | 3500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
68
- | 0.0 | 2.3286 | 4000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
69
- | 0.0 | 2.6197 | 4500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
70
- | 0.0 | 2.9108 | 5000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
71
- | 0.0 | 3.2019 | 5500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
72
- | 0.0 | 3.4929 | 6000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
73
- | 0.0 | 3.7840 | 6500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
74
- | 0.0 | 4.0751 | 7000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
75
- | 0.0 | 4.3662 | 7500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
76
- | 0.0 | 4.6573 | 8000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
77
- | 0.0 | 4.9483 | 8500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
78
- | 0.0 | 5.2394 | 9000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
79
- | 0.0 | 5.5305 | 9500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
80
- | 0.0 | 5.8216 | 10000 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
81
- | 0.0 | 6.1126 | 10500 | nan | 0.0 | 0.0 | 0.0 | 0.9241 |
 
 
 
 
 
 
 
 
 
 
 
 
 
82
 
83
 
84
  ### Framework versions
 
1
  ---
 
2
  library_name: transformers
3
  license: mit
4
+ base_model: haryoaw/scenario-TCR-NER_data-univner_full
5
+ tags:
6
+ - generated_from_trainer
7
  metrics:
8
  - precision
9
  - recall
10
  - f1
11
  - accuracy
 
 
12
  model-index:
13
  - name: scenario-kd-scr-ner-full-mdeberta_data-univner_full55
14
  results: []
 
21
 
22
  This model is a fine-tuned version of [haryoaw/scenario-TCR-NER_data-univner_full](https://huggingface.co/haryoaw/scenario-TCR-NER_data-univner_full) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 180.1557
25
+ - Precision: 0.6958
26
+ - Recall: 0.6184
27
+ - F1: 0.6548
28
+ - Accuracy: 0.9663
29
 
30
  ## Model description
31
 
 
56
 
57
  ### Training results
58
 
59
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
60
+ |:-------------:|:------:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
61
+ | 626.3253 | 0.2911 | 500 | 559.5172 | 0.0 | 0.0 | 0.0 | 0.9241 |
62
+ | 529.6569 | 0.5822 | 1000 | 503.3665 | 0.3596 | 0.0105 | 0.0205 | 0.9244 |
63
+ | 481.9473 | 0.8732 | 1500 | 463.3378 | 0.2837 | 0.1236 | 0.1722 | 0.9308 |
64
+ | 444.8498 | 1.1643 | 2000 | 433.5602 | 0.4233 | 0.0649 | 0.1126 | 0.9292 |
65
+ | 415.1952 | 1.4554 | 2500 | 405.7039 | 0.4916 | 0.3197 | 0.3874 | 0.9445 |
66
+ | 391.3191 | 1.7465 | 3000 | 383.5480 | 0.5120 | 0.4115 | 0.4563 | 0.9502 |
67
+ | 369.4905 | 2.0375 | 3500 | 365.8290 | 0.6227 | 0.3294 | 0.4309 | 0.9480 |
68
+ | 349.644 | 2.3286 | 4000 | 346.1183 | 0.5629 | 0.4978 | 0.5283 | 0.9559 |
69
+ | 332.7872 | 2.6197 | 4500 | 330.6745 | 0.6230 | 0.4712 | 0.5366 | 0.9572 |
70
+ | 317.7756 | 2.9108 | 5000 | 316.2125 | 0.6176 | 0.4956 | 0.5499 | 0.9578 |
71
+ | 302.8933 | 3.2019 | 5500 | 303.1108 | 0.5772 | 0.5927 | 0.5849 | 0.9589 |
72
+ | 289.8367 | 3.4929 | 6000 | 290.9793 | 0.6669 | 0.5076 | 0.5764 | 0.9592 |
73
+ | 278.486 | 3.7840 | 6500 | 280.2549 | 0.6664 | 0.5281 | 0.5892 | 0.9609 |
74
+ | 267.5123 | 4.0751 | 7000 | 268.7850 | 0.6370 | 0.5949 | 0.6152 | 0.9624 |
75
+ | 256.5175 | 4.3662 | 7500 | 259.0105 | 0.6526 | 0.5790 | 0.6136 | 0.9631 |
76
+ | 247.65 | 4.6573 | 8000 | 250.2907 | 0.6609 | 0.6012 | 0.6296 | 0.9641 |
77
+ | 239.1523 | 4.9483 | 8500 | 242.1396 | 0.6456 | 0.6044 | 0.6243 | 0.9635 |
78
+ | 230.5722 | 5.2394 | 9000 | 234.5265 | 0.6762 | 0.5849 | 0.6273 | 0.9641 |
79
+ | 222.7519 | 5.5305 | 9500 | 227.1519 | 0.6838 | 0.5923 | 0.6348 | 0.9645 |
80
+ | 216.3841 | 5.8216 | 10000 | 221.0167 | 0.6938 | 0.5787 | 0.6311 | 0.9643 |
81
+ | 210.8608 | 6.1126 | 10500 | 215.2167 | 0.6795 | 0.5965 | 0.6353 | 0.9642 |
82
+ | 204.422 | 6.4037 | 11000 | 209.7950 | 0.6663 | 0.6214 | 0.6431 | 0.9654 |
83
+ | 199.5391 | 6.6948 | 11500 | 205.1505 | 0.6723 | 0.6110 | 0.6402 | 0.9650 |
84
+ | 194.9082 | 6.9859 | 12000 | 200.7199 | 0.6870 | 0.6113 | 0.6470 | 0.9650 |
85
+ | 190.3632 | 7.2770 | 12500 | 197.2017 | 0.6975 | 0.6035 | 0.6471 | 0.9651 |
86
+ | 186.9785 | 7.5680 | 13000 | 193.4576 | 0.6772 | 0.6265 | 0.6508 | 0.9655 |
87
+ | 183.9405 | 7.8591 | 13500 | 190.7187 | 0.6875 | 0.6126 | 0.6479 | 0.9656 |
88
+ | 181.0169 | 8.1502 | 14000 | 187.9661 | 0.6840 | 0.6324 | 0.6572 | 0.9663 |
89
+ | 178.3527 | 8.4413 | 14500 | 185.6701 | 0.7029 | 0.6076 | 0.6518 | 0.9657 |
90
+ | 176.2939 | 8.7324 | 15000 | 183.7507 | 0.6892 | 0.6102 | 0.6473 | 0.9660 |
91
+ | 174.6214 | 9.0234 | 15500 | 182.2909 | 0.6843 | 0.6259 | 0.6538 | 0.9664 |
92
+ | 173.2938 | 9.3145 | 16000 | 181.6205 | 0.6963 | 0.5976 | 0.6432 | 0.9649 |
93
+ | 172.1101 | 9.6056 | 16500 | 180.5871 | 0.6886 | 0.6272 | 0.6564 | 0.9664 |
94
+ | 172.1252 | 9.8967 | 17000 | 180.1557 | 0.6958 | 0.6184 | 0.6548 | 0.9663 |
95
 
96
 
97
  ### Framework versions
eval_result_ner.json CHANGED
@@ -1 +1 @@
1
- {"ceb_gja": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9606177606177606}, "en_pud": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9260955799017756}, "de_pud": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9299142093666495}, "pt_pud": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9310035459477934}, "ru_pud": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9235856367863601}, "sv_pud": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9247221639756762}, "tl_trg": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9673024523160763}, "tl_ugnayan": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9525979945305378}, "zh_gsd": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.8823676323676324}, "zh_gsdsimp": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.8828671328671329}, "hr_set": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9144270403957131}, "da_ddt": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9357477801057568}, "en_ewt": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9330995736542216}, "pt_bosque": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9222576438197363}, "sr_set": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.8929165572191577}, "sk_snk": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.8910961055276382}, "sv_talbanken": {"precision": 0.0, "recall": 0.0, "f1": 0.0, "accuracy": 0.9881729400795014}}
 
1
+ {"ceb_gja": {"precision": 0.45901639344262296, "recall": 0.5714285714285714, "f1": 0.5090909090909091, "accuracy": 0.9583011583011583}, "en_pud": {"precision": 0.6038709677419355, "recall": 0.43534883720930234, "f1": 0.505945945945946, "accuracy": 0.952682281828485}, "de_pud": {"precision": 0.263782866836302, "recall": 0.2993262752646776, "f1": 0.2804328223624888, "accuracy": 0.9124279218039473}, "pt_pud": {"precision": 0.6438775510204081, "recall": 0.5741583257506825, "f1": 0.607022607022607, "accuracy": 0.9633870209766309}, "ru_pud": {"precision": 0.02564102564102564, "recall": 0.019305019305019305, "f1": 0.02202643171806168, "accuracy": 0.8638078016016533}, "sv_pud": {"precision": 0.654490106544901, "recall": 0.41788143828960156, "f1": 0.5100830367734283, "accuracy": 0.952820297756343}, "tl_trg": {"precision": 0.3333333333333333, "recall": 0.5652173913043478, "f1": 0.4193548387096774, "accuracy": 0.952316076294278}, "tl_ugnayan": {"precision": 0.02631578947368421, "recall": 0.030303030303030304, "f1": 0.028169014084507043, "accuracy": 0.9279854147675478}, "zh_gsd": {"precision": 0.6339285714285714, "recall": 0.6479791395045632, "f1": 0.6408768536428111, "accuracy": 0.951048951048951}, "zh_gsdsimp": {"precision": 0.6434108527131783, "recall": 0.6526867627785059, "f1": 0.6480156148340923, "accuracy": 0.952047952047952}, "hr_set": {"precision": 0.7746675997200839, "recall": 0.7890235210263721, "f1": 0.7817796610169492, "accuracy": 0.9742786479802144}, "da_ddt": {"precision": 0.71875, "recall": 0.6174496644295302, "f1": 0.6642599277978339, "accuracy": 0.9751571385812631}, "en_ewt": {"precision": 0.69185360094451, "recall": 0.5386029411764706, "f1": 0.6056847545219638, "accuracy": 0.9628640873411165}, "pt_bosque": {"precision": 0.7205479452054795, "recall": 0.6493827160493827, "f1": 0.6831168831168832, "accuracy": 0.9705477467033763}, "sr_set": {"precision": 0.8327526132404182, "recall": 0.846517119244392, "f1": 0.8395784543325527, "accuracy": 0.9758339900183872}, "sk_snk": {"precision": 0.5059880239520959, "recall": 0.3693989071038251, "f1": 0.42703727100442196, "accuracy": 0.9280778894472361}, "sv_talbanken": {"precision": 0.7692307692307693, "recall": 0.6632653061224489, "f1": 0.7123287671232876, "accuracy": 0.9949943563821956}}
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a17e1b58722cbfa169073c590fa2d17fb6cba0d515b0020d5211ca6310aad01a
3
  size 972678148
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1552e1c0d65fac8a98447f1a0b0ce2513302d76f5affbd2ae63fa188091449f
3
  size 972678148
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7644a8a614266dd19e11dceb31c5a835c7d0995191644c59f9fe70d1f71d7c49
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5d0a1a46ea1ee819195a9848a2dcdd01e3409b0a2bc9027763ba0d952e16cc7
3
  size 5304