Update README.md
Browse files
README.md
CHANGED
@@ -8,10 +8,10 @@ We evaluated our model using the following JGLUE tasks. Here are the scores:
|
|
8 |
|
9 |
| Task | Score |
|
10 |
|----------------|---------:|
|
11 |
-
| JSQUAD
|
12 |
-
| JCOMMONSENSEQA | 0.7578 |
|
13 |
-
| JNLI | 0.5069 |
|
14 |
-
| MARC_JA |
|
15 |
|
16 |
The JGLUE scores were measured using the following script:
|
17 |
[https://github.com/Stability-AI/lm-evaluation-harness/tree/jp-stable]
|
|
|
8 |
|
9 |
| Task | Score |
|
10 |
|----------------|---------:|
|
11 |
+
| JSQUAD(exact_match) | 62.83 |
|
12 |
+
| JCOMMONSENSEQA(acc) | 0.7578 |
|
13 |
+
| JNLI(acc) | 0.5069 |
|
14 |
+
| MARC_JA(acc) | - |
|
15 |
|
16 |
The JGLUE scores were measured using the following script:
|
17 |
[https://github.com/Stability-AI/lm-evaluation-harness/tree/jp-stable]
|