Sennodipoi
commited on
Commit
•
e89dcc9
1
Parent(s):
40361a7
Update README.md
Browse files
README.md
CHANGED
@@ -1 +1,16 @@
|
|
1 |
-
LayoutLMv3 fine-tuned on the Kleister-NDA dataset. Code (including pre-processing) and results are available at the official GitHub repository of my [Master Degree thesis ](https://github.com/AleRosae/thesis-layoutlm)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
LayoutLMv3 fine-tuned on the Kleister-NDA dataset. Code (including pre-processing) and results are available at the official GitHub repository of my [Master Degree thesis ](https://github.com/AleRosae/thesis-layoutlm).
|
2 |
+
|
3 |
+
Results obtained with seqeval in strict mode:
|
4 |
+
|
5 |
+
|
6 |
+
| | Precision | Recall | F1-score | Variance (F1) |
|
7 |
+
|----------------|-----------|--------|----------|---------------|
|
8 |
+
| EFFECTIVE_DATE | 0.92 | 0.99 | 0.95 | 5e-5 |
|
9 |
+
| JURISDICTION | 0.87 | 0.88 | 0.88 | 8e-6 |
|
10 |
+
| PARTY | 0.92 | 0.99 | 0.95 | 5e-5 |
|
11 |
+
| TERM | 1 | 1 | 1 | 0 |
|
12 |
+
| Micro avg | 0.91 | 0.96 | 0.94 | 2e-5 |
|
13 |
+
| Macro avg | 0.92 | 0.96 | 0.94 | 3e-7 |
|
14 |
+
| Weighted avg | 0.91 | 0.96 | 0.94 | 2e-5 |
|
15 |
+
|
16 |
+
Since I used the same segmentation strategy of the original paper i.e. using the labels to create segments, the scores are not directly comparable with the other LayoutLM versions.
|