dennispark
commited on
Commit
β’
67e56de
1
Parent(s):
7f7be89
Update README.md
Browse files
README.md
CHANGED
@@ -33,15 +33,16 @@ print(f"loss={outputs.loss} logits={outputs.logits}")
|
|
33 |
|
34 |
## Klue νκ° (dev)
|
35 |
|
36 |
-
|
37 |
-
|
|
38 |
-
|
39 |
-
|
|
40 |
-
| FT
|
41 |
-
| FT
|
42 |
-
|
|
43 |
-
| MT
|
44 |
-
| MT
|
|
|
45 |
|
46 |
- FT: μ±κΈνμ€ν¬ νμΈνλ / MT: λ©ν°νμ€ν¬ νμΈνλ
|
47 |
- [Baseline](https://arxiv.org/abs/2105.09680): KLUE λ
Όλ¬Έμμ μκ°λ dev set μ λν SOTA μ μ
|
|
|
33 |
|
34 |
## Klue νκ° (dev)
|
35 |
|
36 |
+
|
37 |
+
| | Model | ynat (macro F1) | sts (pearsonr/F1) | nli (acc) | ner (entity-level F1) | re (micro F1) | dp (LAS) | mrc (EM/F1) |
|
38 |
+
|-----|------------------------------------------------------------------|-----------------|-------------------|-----------|-----------------------|---------------|-----------|-------------|
|
39 |
+
| | Baseline | **87.30** | **93.20/86.13** | **89.50** | 86.06 | 71.06 | 87.93 | **75.26/-** |
|
40 |
+
| FT | [pko-t5-small](https://huggingface.co/paust/pko-t5-small) (77M) | 86.21 | 77.99/77.01 | 69.20 | 82.60 | 66.46 | 93.15 | 43.81/46.58 |
|
41 |
+
| FT | [pko-t5-base](https://huggingface.co/paust/pko-t5-base) (250M) | 87.29 | 90.25/83.43 | 79.73 | 87.80 | 67.23 | 97.28 | 61.53/64.74 |
|
42 |
+
| FT | [pko-t5-large](https://huggingface.co/paust/pko-t5-large) (800M) | 87.12 | 92.05/85.24 | 84.96 | **88.18** | **75.17** | **97.60** | 68.01/71.44 |
|
43 |
+
| MT | pko-t5-small | 84.54 | 68.50/72/02 | 51.16 | 74.69 | 66.11 | 80.40 | 43.60/46.28 |
|
44 |
+
| MT | pko-t5-base | 86.89 | 83.96/80.30 | 72.03 | 85.27 | 66.59 | 95.05 | 61.11/63.94 |
|
45 |
+
| MT | pko-t5-large | 87.57 | 91.93/86.29 | 83.63 | 87.41 | 71.34 | 96.99 | 70.70/73.72 |
|
46 |
|
47 |
- FT: μ±κΈνμ€ν¬ νμΈνλ / MT: λ©ν°νμ€ν¬ νμΈνλ
|
48 |
- [Baseline](https://arxiv.org/abs/2105.09680): KLUE λ
Όλ¬Έμμ μκ°λ dev set μ λν SOTA μ μ
|