commit files to HF hub

README.md

@@ -31,33 +31,33 @@ model-index:
     metrics:
     - name: BLEU4 (Question Answering)
       type: bleu4_question_answering
-      value: 0.0
+      value: 18.17
     - name: ROUGE-L (Question Answering)
       type: rouge_l_question_answering
-      value: 0.09
+      value: 38.1
     - name: METEOR (Question Answering)
       type: meteor_question_answering
-      value: 0.23
+      value: 33.21
     - name: BERTScore (Question Answering)
       type: bertscore_question_answering
-      value: 70.44
+      value: 91.62
     - name: MoverScore (Question Answering)
       type: moverscore_question_answering
-      value: 52.74
+      value: 76.82
     - name: AnswerF1Score (Question Answering)
       type: answer_f1_score__question_answering
-      value: 0.11
+      value: 62.16
     - name: AnswerExactMatch (Question Answering)
       type: answer_exact_match_question_answering
-      value: 0.03
+      value: 41.45
 ---
 
 # Model Card of `vocabtrimmer/mt5-small-trimmed-es-15000-esquad-qa`
-This model is fine-tuned version of [vocabtrimmer/mt5-small-trimmed-es-15000](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-15000) for question answering task on the [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
+This model is fine-tuned version of [ckpts/mt5-small-trimmed-es-15000](https://huggingface.co/ckpts/mt5-small-trimmed-es-15000) for question answering task on the [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
 
 
 ### Overview
-- **Language model:** [vocabtrimmer/mt5-small-trimmed-es-15000](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-15000)   
+- **Language model:** [ckpts/mt5-small-trimmed-es-15000](https://huggingface.co/ckpts/mt5-small-trimmed-es-15000)   
 - **Language:** es  
 - **Training data:** [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) (default)
 - **Online Demo:** [https://autoqg.net/](https://autoqg.net/)
@@ -93,16 +93,16 @@ output = pipe("question: ¿Cuál es la población de Nueva York a partir de 2014
 
 |                  |   Score | Type    | Dataset                                                          |
 |:-----------------|--------:|:--------|:-----------------------------------------------------------------|
-| AnswerExactMatch |    0.03 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| AnswerF1Score    |    0.11 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| BERTScore        |   70.44 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_1           |    0.11 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_2           |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_3           |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_4           |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| METEOR           |    0.23 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| MoverScore       |   52.74 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| ROUGE_L          |    0.09 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| AnswerExactMatch |   41.45 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| AnswerF1Score    |   62.16 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| BERTScore        |   91.62 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_1           |   28.53 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_2           |   23.91 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_3           |   20.72 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_4           |   18.17 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| METEOR           |   33.21 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| MoverScore       |   76.82 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| ROUGE_L          |   38.1  | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 
 
 
@@ -114,7 +114,7 @@ The following hyperparameters were used during fine-tuning:
  - input_types: ['paragraph_question']
  - output_types: ['answer']
  - prefix_types: None
- - model: vocabtrimmer/mt5-small-trimmed-es-15000
+ - model: ckpts/mt5-small-trimmed-es-15000
  - max_length: 512
  - max_length_output: 32
  - epoch: 14

eval/metric.first.answer.paragraph_question.answer.lmqg_qg_esquad.default.json

@@ -1 +1 @@
-{"validation": {"Bleu_1": 0.001004352192835611, "Bleu_2": 0.00010461696464441498, "Bleu_3": 5.099887755116005e-10, "Bleu_4": 1.156316714724265e-12, "METEOR": 0.0020535579790744705, "ROUGE_L": 0.001018285123475979, "BERTScore": 0.7129212742835255, "MoverScore": 0.5258865046147834, "AnswerF1Score": 0.1094663389985188, "AnswerExactMatch": 0.0}, "test": {"Bleu_1": 0.0011051068100939735, "Bleu_2": 3.5244397866600116e-12, "Bleu_3": 5.37736898747529e-15, "Bleu_4": 2.157958293940156e-16, "METEOR": 0.0022891187205383093, "ROUGE_L": 0.0009444767193886489, "BERTScore": 0.7044496615426994, "MoverScore": 0.5273608724144386, "AnswerF1Score": 0.11371334603918257, "AnswerExactMatch": 0.02838221381267739}}
+{"validation": {"Bleu_1": 0.26373484236054545, "Bleu_2": 0.2186777098857219, "Bleu_3": 0.18705861160620701, "Bleu_4": 0.16193034837860076, "METEOR": 0.32464668075595776, "ROUGE_L": 0.37181959261044173, "BERTScore": 0.9106625634087857, "MoverScore": 0.7543081392585878, "AnswerF1Score": 59.784639937544505, "AnswerExactMatch": 38.54304635761589}, "test": {"Bleu_1": 0.28526070937398706, "Bleu_2": 0.2390707992690809, "Bleu_3": 0.20720178563616617, "Bleu_4": 0.18169954477694708, "METEOR": 0.3320529393361048, "ROUGE_L": 0.38100050149610076, "BERTScore": 0.9161858492959978, "MoverScore": 0.7682198922921386, "AnswerF1Score": 62.16410905553706, "AnswerExactMatch": 41.44749290444655}}