mingaflo commited on
Commit
47f3dea
1 Parent(s): 67736f9

Update README.md

Browse files

The reported results do not match what is written in the paper.
The paper reported a **micro** F1 Score.

A 70% micro F1 Score on the REBEL Dataset would also not be SOTA, since REBEL achieved 74 micro-F1 Score (Section 5 in https://aclanthology.org/2021.findings-emnlp.204.pdf)

Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -25,9 +25,9 @@ model-index:
25
  name: Babelscape/rebel-dataset
26
  type: REBEL
27
  metrics:
28
- - type: re+ macro f1
29
  value: 70.74
30
- name: RE+ Macro F1
31
  ---
32
 
33
  # KnowGL: Knowledge Generation and Linking from Text
@@ -38,7 +38,7 @@ The `knowgl-large` model is trained by combining Wikidata with an extended versi
38
  ```
39
  If there are more than one triples generated, they are separated by `$` in the output. More details in [Rossiello et al. (AAAI 2023)](https://arxiv.org/pdf/2210.13952.pdf).
40
 
41
- The model achieves state-of-the-art results for relation extraction on the REBEL dataset. See results in [Mihindukulasooriya et al. (ISWC 2022)](https://arxiv.org/pdf/2207.05188.pdf).
42
 
43
  The generated labels (for the subject, relation, and object) and their types can be directly mapped to Wikidata IDs associated with them.
44
 
 
25
  name: Babelscape/rebel-dataset
26
  type: REBEL
27
  metrics:
28
+ - type: re+ micro f1
29
  value: 70.74
30
+ name: RE+ Micro F1
31
  ---
32
 
33
  # KnowGL: Knowledge Generation and Linking from Text
 
38
  ```
39
  If there are more than one triples generated, they are separated by `$` in the output. More details in [Rossiello et al. (AAAI 2023)](https://arxiv.org/pdf/2210.13952.pdf).
40
 
41
+ The model achieves good results for relation extraction on the REBEL dataset. See results in [Mihindukulasooriya et al. (ISWC 2022)](https://arxiv.org/pdf/2207.05188.pdf).
42
 
43
  The generated labels (for the subject, relation, and object) and their types can be directly mapped to Wikidata IDs associated with them.
44