Commit
•
590278a
1
Parent(s):
f50fcc3
Update README.md (#11)
Browse files- Update README.md (5048576e84fff1adb4dea8de874a0839b3aef6c8)
Co-authored-by: Pakawat Phasook <SuperkingbasSKB@users.noreply.huggingface.co>
README.md
CHANGED
@@ -34,12 +34,15 @@ With `transformers<4.37.0`, you will encounter the following error:
|
|
34 |
```
|
35 |
KeyError: 'qwen2'
|
36 |
```
|
|
|
|
|
|
|
37 |
|
38 |
## Evaluation Performance
|
39 |
-
| Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) |
|
40 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
41 |
-
| OpenthaiLLM-Prebuilt-7B | **0.
|
42 |
-
| SeaLLM-v3-7B | 0.4753 | 0.6421 | 0.6153 | 0.3275 | 0.3464 | 0.4813 | 0.7037 | 0.4907 | 0.4625 |
|
43 |
| llama-3-typhoon-v1.5-8B | 0.3765 | 0.3473 | 0.5538 | 0.4137 | 0.2913 | 0.3965 | 0.6451 | 0.4312 | 0.4125 |
|
44 |
| Qwen-2-7B | 0.4814 | 0.621 | 0.6153 | 0.3448 | 0.3385 | 0.4802 | 0.7073 | 0.4949 | 0.4807 |
|
45 |
| Meta-Llama-3.1-8B | 0.3641 | 0.2631 | 0.2769 | 0.3793 | 0.1811 | 0.2929 | 0.6591 | 0.4239 | 0.3583 |
|
|
|
34 |
```
|
35 |
KeyError: 'qwen2'
|
36 |
```
|
37 |
+
## **Support Community**
|
38 |
+
|
39 |
+
**https://discord.gg/JsezgAf7**
|
40 |
|
41 |
## Evaluation Performance
|
42 |
+
| Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | MMLU | M3Exam | M6Exam |
|
43 |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
|
44 |
+
| OpenthaiLLM-Prebuilt-7B | **0.5493** | 0.6315 | **0.6307** | **0.4655** | **0.37** | **0.5294** | **0.7054** | **0.5705** | **0.596** |
|
45 |
+
| SeaLLM-v3-7B | 0.4753 | **0.6421** | 0.6153 | 0.3275 | 0.3464 | 0.4813 | 0.7037 | 0.4907 | 0.4625 | 0.3666 |
|
46 |
| llama-3-typhoon-v1.5-8B | 0.3765 | 0.3473 | 0.5538 | 0.4137 | 0.2913 | 0.3965 | 0.6451 | 0.4312 | 0.4125 |
|
47 |
| Qwen-2-7B | 0.4814 | 0.621 | 0.6153 | 0.3448 | 0.3385 | 0.4802 | 0.7073 | 0.4949 | 0.4807 |
|
48 |
| Meta-Llama-3.1-8B | 0.3641 | 0.2631 | 0.2769 | 0.3793 | 0.1811 | 0.2929 | 0.6591 | 0.4239 | 0.3583 |
|