Tatiana239
commited on
Commit
•
f157d36
1
Parent(s):
c508af1
End of training
Browse files
README.md
CHANGED
@@ -14,18 +14,18 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
|
15 |
This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on the None dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
-
- Loss:
|
18 |
-
- Comment: {'precision':
|
19 |
-
- Date: {'precision': 0.
|
20 |
-
- Labname: {'precision': 0.
|
21 |
-
- Laboratory: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number':
|
22 |
-
- Measure: {'precision':
|
23 |
-
- Ref Value: {'precision': 0.
|
24 |
-
- Result: {'precision':
|
25 |
-
- Overall Precision: 0.
|
26 |
-
- Overall Recall: 0.
|
27 |
-
- Overall F1: 0.
|
28 |
-
- Overall Accuracy: 0.
|
29 |
|
30 |
## Model description
|
31 |
|
@@ -45,28 +45,23 @@ More information needed
|
|
45 |
|
46 |
The following hyperparameters were used during training:
|
47 |
- learning_rate: 5e-05
|
48 |
-
- train_batch_size:
|
49 |
-
- eval_batch_size:
|
50 |
- seed: 42
|
51 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
52 |
- lr_scheduler_type: linear
|
53 |
-
- training_steps:
|
54 |
- mixed_precision_training: Native AMP
|
55 |
|
56 |
### Training results
|
57 |
|
58 |
-
| Training Loss | Epoch | Step | Validation Loss | Comment
|
59 |
-
|
60 |
-
|
|
61 |
-
|
|
62 |
-
|
|
63 |
-
|
|
64 |
-
|
|
65 |
-
| 2.1588 | 3.0 | 6 | 1.9684 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 23} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 1} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 10} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 3} | 0.0 | 0.0 | 0.0 | 0.375 |
|
66 |
-
| 1.0594 | 3.5 | 7 | 2.0123 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 23} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 1} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 10} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 3} | 0.0 | 0.0 | 0.0 | 0.375 |
|
67 |
-
| 2.0705 | 4.0 | 8 | 1.8896 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 23} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 1} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 10} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 3} | 0.0 | 0.0 | 0.0 | 0.375 |
|
68 |
-
| 1.9698 | 4.5 | 9 | 1.7493 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 23} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 1} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 10} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 3} | 0.0 | 0.0 | 0.0 | 0.375 |
|
69 |
-
| 0.8502 | 5.0 | 10 | 1.6972 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 23} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 1} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 10} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 3} | 0.0 | 0.0 | 0.0 | 0.375 |
|
70 |
|
71 |
|
72 |
### Framework versions
|
|
|
14 |
|
15 |
This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on the None dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
+
- Loss: 0.2043
|
18 |
+
- Comment: {'precision': 1.0, 'recall': 0.9444444444444444, 'f1': 0.9714285714285714, 'number': 18}
|
19 |
+
- Date: {'precision': 0.8571428571428571, 'recall': 0.75, 'f1': 0.7999999999999999, 'number': 8}
|
20 |
+
- Labname: {'precision': 0.6666666666666666, 'recall': 0.8, 'f1': 0.7272727272727272, 'number': 5}
|
21 |
+
- Laboratory: {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 2}
|
22 |
+
- Measure: {'precision': 1.0, 'recall': 0.9230769230769231, 'f1': 0.9600000000000001, 'number': 13}
|
23 |
+
- Ref Value: {'precision': 0.875, 'recall': 1.0, 'f1': 0.9333333333333333, 'number': 14}
|
24 |
+
- Result: {'precision': 1.0, 'recall': 0.9285714285714286, 'f1': 0.962962962962963, 'number': 14}
|
25 |
+
- Overall Precision: 0.9296
|
26 |
+
- Overall Recall: 0.8919
|
27 |
+
- Overall F1: 0.9103
|
28 |
+
- Overall Accuracy: 0.9563
|
29 |
|
30 |
## Model description
|
31 |
|
|
|
45 |
|
46 |
The following hyperparameters were used during training:
|
47 |
- learning_rate: 5e-05
|
48 |
+
- train_batch_size: 8
|
49 |
+
- eval_batch_size: 8
|
50 |
- seed: 42
|
51 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
52 |
- lr_scheduler_type: linear
|
53 |
+
- training_steps: 25
|
54 |
- mixed_precision_training: Native AMP
|
55 |
|
56 |
### Training results
|
57 |
|
58 |
+
| Training Loss | Epoch | Step | Validation Loss | Comment | Date | Labname | Laboratory | Measure | Ref Value | Result | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|
59 |
+
|:-------------:|:-----:|:----:|:---------------:|:------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------:|:---------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
|
60 |
+
| 1.2584 | 5.0 | 5 | 0.9810 | {'precision': 1.0, 'recall': 0.05555555555555555, 'f1': 0.10526315789473684, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 2} | {'precision': 0.6666666666666666, 'recall': 0.3076923076923077, 'f1': 0.42105263157894735, 'number': 13} | {'precision': 0.5714285714285714, 'recall': 0.2857142857142857, 'f1': 0.38095238095238093, 'number': 14} | {'precision': 0.4482758620689655, 'recall': 0.9285714285714286, 'f1': 0.6046511627906977, 'number': 14} | 0.44 | 0.2973 | 0.3548 | 0.7125 |
|
61 |
+
| 0.6614 | 10.0 | 10 | 0.5382 | {'precision': 0.8947368421052632, 'recall': 0.9444444444444444, 'f1': 0.918918918918919, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.6666666666666666, 'recall': 0.8, 'f1': 0.7272727272727272, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 2} | {'precision': 0.8333333333333334, 'recall': 0.38461538461538464, 'f1': 0.5263157894736842, 'number': 13} | {'precision': 0.8125, 'recall': 0.9285714285714286, 'f1': 0.8666666666666666, 'number': 14} | {'precision': 1.0, 'recall': 0.7857142857142857, 'f1': 0.88, 'number': 14} | 0.8475 | 0.6757 | 0.7519 | 0.9 |
|
62 |
+
| 0.3955 | 15.0 | 15 | 0.3360 | {'precision': 0.8947368421052632, 'recall': 0.9444444444444444, 'f1': 0.918918918918919, 'number': 18} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 8} | {'precision': 0.6666666666666666, 'recall': 0.8, 'f1': 0.7272727272727272, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 2} | {'precision': 0.8333333333333334, 'recall': 0.38461538461538464, 'f1': 0.5263157894736842, 'number': 13} | {'precision': 0.8125, 'recall': 0.9285714285714286, 'f1': 0.8666666666666666, 'number': 14} | {'precision': 1.0, 'recall': 0.7857142857142857, 'f1': 0.88, 'number': 14} | 0.8475 | 0.6757 | 0.7519 | 0.9 |
|
63 |
+
| 0.2654 | 20.0 | 20 | 0.2405 | {'precision': 1.0, 'recall': 0.8888888888888888, 'f1': 0.9411764705882353, 'number': 18} | {'precision': 0.8571428571428571, 'recall': 0.75, 'f1': 0.7999999999999999, 'number': 8} | {'precision': 0.6666666666666666, 'recall': 0.8, 'f1': 0.7272727272727272, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 2} | {'precision': 1.0, 'recall': 0.9230769230769231, 'f1': 0.9600000000000001, 'number': 13} | {'precision': 0.875, 'recall': 1.0, 'f1': 0.9333333333333333, 'number': 14} | {'precision': 0.9285714285714286, 'recall': 0.9285714285714286, 'f1': 0.9285714285714286, 'number': 14} | 0.9155 | 0.8784 | 0.8966 | 0.95 |
|
64 |
+
| 0.2125 | 25.0 | 25 | 0.2043 | {'precision': 1.0, 'recall': 0.9444444444444444, 'f1': 0.9714285714285714, 'number': 18} | {'precision': 0.8571428571428571, 'recall': 0.75, 'f1': 0.7999999999999999, 'number': 8} | {'precision': 0.6666666666666666, 'recall': 0.8, 'f1': 0.7272727272727272, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 2} | {'precision': 1.0, 'recall': 0.9230769230769231, 'f1': 0.9600000000000001, 'number': 13} | {'precision': 0.875, 'recall': 1.0, 'f1': 0.9333333333333333, 'number': 14} | {'precision': 1.0, 'recall': 0.9285714285714286, 'f1': 0.962962962962963, 'number': 14} | 0.9296 | 0.8919 | 0.9103 | 0.9563 |
|
|
|
|
|
|
|
|
|
|
|
65 |
|
66 |
|
67 |
### Framework versions
|
logs/events.out.tfevents.1674200616.pc092u.2752457.3
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d78c434cde0cc982d27a775abda0094fe4faa6380322f16af9e0bb9a01552a75
|
3 |
+
size 8030
|
logs/events.out.tfevents.1674200673.pc092u.2752457.5
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:637b7d27a8ee3d6cf72b3f0211c972c6303a57188eb05f1d577b3ac68eb60728
|
3 |
+
size 535
|
pytorch_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 520839775
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c30f86fa2e3eaf0643cd5d777c39cd0fdec184b51a148449f44bc9dfff8df20f
|
3 |
size 520839775
|