model update
Browse files
README.md
CHANGED
@@ -46,6 +46,12 @@ model-index:
|
|
46 |
- name: MoverScore
|
47 |
type: moverscore
|
48 |
value: 0.5987761972106114
|
|
|
|
|
|
|
|
|
|
|
|
|
49 |
---
|
50 |
|
51 |
# Model Card of `lmqg/mbart-large-cc25-jaquad`
|
@@ -112,6 +118,13 @@ question = pipe('ゾフィーは貴族出身ではあったが王族出身では
|
|
112 |
| [lmqg/qg_jaquad](https://huggingface.co/datasets/lmqg/qg_jaquad) | default | 0.322 | 0.529 | 0.3 | 0.823 | 0.599 | [link](https://huggingface.co/lmqg/mbart-large-cc25-jaquad/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_jaquad.default.json) |
|
113 |
|
114 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
115 |
|
116 |
|
117 |
## Training hyperparameters
|
|
|
46 |
- name: MoverScore
|
47 |
type: moverscore
|
48 |
value: 0.5987761972106114
|
49 |
+
- name: QAAlignedF1Score (BERTScore)
|
50 |
+
type: qa_aligned_f1_score_bertscore
|
51 |
+
value: 0.8716389802680674
|
52 |
+
- name: QAAlignedF1Score (MoverScore)
|
53 |
+
type: qa_aligned_f1_score_moverscore
|
54 |
+
value: 0.6308136319057531
|
55 |
---
|
56 |
|
57 |
# Model Card of `lmqg/mbart-large-cc25-jaquad`
|
|
|
118 |
| [lmqg/qg_jaquad](https://huggingface.co/datasets/lmqg/qg_jaquad) | default | 0.322 | 0.529 | 0.3 | 0.823 | 0.599 | [link](https://huggingface.co/lmqg/mbart-large-cc25-jaquad/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_jaquad.default.json) |
|
119 |
|
120 |
|
121 |
+
### Metrics (QAG)
|
122 |
+
|
123 |
+
| Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
|
124 |
+
|:--------|:-----|--------------------------------:|---------------------------------:|-----:|
|
125 |
+
| [lmqg/qg_jaquad](https://huggingface.co/datasets/lmqg/qg_jaquad) | default | 0.872 | 0.631 | [link](https://huggingface.co/lmqg/mbart-large-cc25-jaquad/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_jaquad.default.json) |
|
126 |
+
|
127 |
+
|
128 |
|
129 |
|
130 |
## Training hyperparameters
|