HachiML
/

Llama-2-13b-hf-qlora-dolly-ja-2ep

Model card Files Files and versions Community

HachiML commited on Aug 6, 2023

Commit

1b33b53

•

1 Parent(s): 8bcec92

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -9,9 +9,11 @@ We evaluated our model using the following JGLUE tasks. Here are the scores:
 | Task           | Score    |
 |----------------|---------:|
 | JSQUAD(exact_match) | 62.83  |
-| JCOMMONSENSEQA(acc) | 0.7578  |
-| JNLI(acc)           | 0.5069  |
 | MARC_JA(acc)        | -  |
 The JGLUE scores were measured using the following script:
 [Stability-AI/lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness/tree/jp-stable)

 | Task           | Score    |
 |----------------|---------:|
 | JSQUAD(exact_match) | 62.83  |
+| JCOMMONSENSEQA(acc) | 75.78  |
+| JNLI(acc)           | 50.69  |
 | MARC_JA(acc)        | -  |
+|----------------|---------:|
+| Average        | - |
 The JGLUE scores were measured using the following script:
 [Stability-AI/lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness/tree/jp-stable)