model update
Browse files
README.md
CHANGED
@@ -53,22 +53,22 @@ model-index:
|
|
53 |
value: 0.551016955735025
|
54 |
- name: QAAlignedF1Score (BERTScore)
|
55 |
type: qa_aligned_f1_score_bertscore
|
56 |
-
value: 0.
|
57 |
- name: QAAlignedRecall (BERTScore)
|
58 |
type: qa_aligned_recall_bertscore
|
59 |
-
value: 0.
|
60 |
- name: QAAlignedPrecision (BERTScore)
|
61 |
type: qa_aligned_precision_bertscore
|
62 |
-
value: 0.
|
63 |
- name: QAAlignedF1Score (MoverScore)
|
64 |
type: qa_aligned_f1_score_moverscore
|
65 |
-
value: 0.
|
66 |
- name: QAAlignedRecall (MoverScore)
|
67 |
type: qa_aligned_recall_moverscore
|
68 |
-
value: 0.
|
69 |
- name: QAAlignedPrecision (MoverScore)
|
70 |
type: qa_aligned_precision_moverscore
|
71 |
-
value: 0.
|
72 |
---
|
73 |
|
74 |
# Model Card of `lmqg/mt5-small-dequad-multitask`
|
@@ -141,7 +141,7 @@ question = pipe('generate question: <hl> Beyonce <hl> further expanded her actin
|
|
141 |
|
142 |
| Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
|
143 |
|:--------|:-----|--------------------------------:|---------------------------------:|-----:|
|
144 |
-
| [lmqg/qg_dequad](https://huggingface.co/datasets/lmqg/qg_dequad) | default | 0.8 | 0.
|
145 |
|
146 |
|
147 |
|
|
|
53 |
value: 0.551016955735025
|
54 |
- name: QAAlignedF1Score (BERTScore)
|
55 |
type: qa_aligned_f1_score_bertscore
|
56 |
+
value: 0.8001787025118497
|
57 |
- name: QAAlignedRecall (BERTScore)
|
58 |
type: qa_aligned_recall_bertscore
|
59 |
+
value: 0.812320688466097
|
60 |
- name: QAAlignedPrecision (BERTScore)
|
61 |
type: qa_aligned_precision_bertscore
|
62 |
+
value: 0.7891379324540309
|
63 |
- name: QAAlignedF1Score (MoverScore)
|
64 |
type: qa_aligned_f1_score_moverscore
|
65 |
+
value: 0.5399337820733731
|
66 |
- name: QAAlignedRecall (MoverScore)
|
67 |
type: qa_aligned_recall_moverscore
|
68 |
+
value: 0.5427046152241427
|
69 |
- name: QAAlignedPrecision (MoverScore)
|
70 |
type: qa_aligned_precision_moverscore
|
71 |
+
value: 0.537701100527795
|
72 |
---
|
73 |
|
74 |
# Model Card of `lmqg/mt5-small-dequad-multitask`
|
|
|
141 |
|
142 |
| Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
|
143 |
|:--------|:-----|--------------------------------:|---------------------------------:|-----:|
|
144 |
+
| [lmqg/qg_dequad](https://huggingface.co/datasets/lmqg/qg_dequad) | default | 0.8 | 0.54 | [link](https://huggingface.co/lmqg/mt5-small-dequad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_dequad.default.json) |
|
145 |
|
146 |
|
147 |
|