Small fixes in README
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ widget:
|
|
13 |
- text: "He ate a sweet apple. What is the definition of apple?"
|
14 |
example_title: "Definition generation"
|
15 |
- text: "The paper contains a number of original ideas about color perception. What is the definition of original?"
|
16 |
-
example_title: "
|
17 |
license: cc-by-sa-4.0
|
18 |
datasets:
|
19 |
- marksverdhei/wordnet-definitions-en-2021
|
@@ -34,7 +34,7 @@ See details in the paper `Interpretable Word Sense Representations via Definitio
|
|
34 |
|
35 |
The model is intended for research purposes, as a source of contextualized dictionary-like lexical definitions.
|
36 |
|
37 |
-
The fine-tuning datasets were limited to English
|
38 |
Although the original FLAN-T5 is a multilingual model, we did not thoroughly evaluate its ability to generate definitions in languages other than English.
|
39 |
|
40 |
Generated definitions can contain all sorts of biases and stereotypes, stemming from the underlying language model.
|
@@ -47,12 +47,12 @@ Three datasets were used to fine-tune the model:
|
|
47 |
- *Oxford dictionary or CHA* ([Gadetsky et al., ACL 2018](https://aclanthology.org/P18-2043/))
|
48 |
- English subset of *CodWoE* ([Mickus et al., SemEval 2022](https://aclanthology.org/2022.semeval-1.1/))
|
49 |
|
50 |
-
FLAN-T5-Definition XL achieves the following results on the WordNet test set
|
51 |
- ROUGE-L: 52.21
|
52 |
- BLEU: 32.81
|
53 |
- BERT-F1: 92.16
|
54 |
|
55 |
-
FLAN-T5-Definition XL achieves the following results on the Oxford dictionary test set
|
56 |
- ROUGE-L: 38.72
|
57 |
- BLEU: 18.69
|
58 |
- BERT-F1: 89.75
|
|
|
13 |
- text: "He ate a sweet apple. What is the definition of apple?"
|
14 |
example_title: "Definition generation"
|
15 |
- text: "The paper contains a number of original ideas about color perception. What is the definition of original?"
|
16 |
+
example_title: "Definition generation"
|
17 |
license: cc-by-sa-4.0
|
18 |
datasets:
|
19 |
- marksverdhei/wordnet-definitions-en-2021
|
|
|
34 |
|
35 |
The model is intended for research purposes, as a source of contextualized dictionary-like lexical definitions.
|
36 |
|
37 |
+
The fine-tuning datasets were limited to English.
|
38 |
Although the original FLAN-T5 is a multilingual model, we did not thoroughly evaluate its ability to generate definitions in languages other than English.
|
39 |
|
40 |
Generated definitions can contain all sorts of biases and stereotypes, stemming from the underlying language model.
|
|
|
47 |
- *Oxford dictionary or CHA* ([Gadetsky et al., ACL 2018](https://aclanthology.org/P18-2043/))
|
48 |
- English subset of *CodWoE* ([Mickus et al., SemEval 2022](https://aclanthology.org/2022.semeval-1.1/))
|
49 |
|
50 |
+
FLAN-T5-Definition XL achieves the following results on the WordNet test set:
|
51 |
- ROUGE-L: 52.21
|
52 |
- BLEU: 32.81
|
53 |
- BERT-F1: 92.16
|
54 |
|
55 |
+
FLAN-T5-Definition XL achieves the following results on the Oxford dictionary test set:
|
56 |
- ROUGE-L: 38.72
|
57 |
- BLEU: 18.69
|
58 |
- BERT-F1: 89.75
|