jackJessada SuperkingbasSKB commited on
Commit
590278a
1 Parent(s): f50fcc3

Update README.md (#11)

Browse files

- Update README.md (5048576e84fff1adb4dea8de874a0839b3aef6c8)


Co-authored-by: Pakawat Phasook <SuperkingbasSKB@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -34,12 +34,15 @@ With `transformers<4.37.0`, you will encounter the following error:
34
  ```
35
  KeyError: 'qwen2'
36
  ```
 
 
 
37
 
38
  ## Evaluation Performance
39
- | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | M3Exam (1 shot) | MMLU |
40
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
41
- | OpenthaiLLM-Prebuilt-7B | **0.5185** | **0.6421** | **0.6461** | **0.4224** | **0.3937** | **0.5245** | **0.5355** | 0.6644 |
42
- | SeaLLM-v3-7B | 0.4753 | 0.6421 | 0.6153 | 0.3275 | 0.3464 | 0.4813 | 0.7037 | 0.4907 | 0.4625 |
43
  | llama-3-typhoon-v1.5-8B | 0.3765 | 0.3473 | 0.5538 | 0.4137 | 0.2913 | 0.3965 | 0.6451 | 0.4312 | 0.4125 |
44
  | Qwen-2-7B | 0.4814 | 0.621 | 0.6153 | 0.3448 | 0.3385 | 0.4802 | 0.7073 | 0.4949 | 0.4807 |
45
  | Meta-Llama-3.1-8B | 0.3641 | 0.2631 | 0.2769 | 0.3793 | 0.1811 | 0.2929 | 0.6591 | 0.4239 | 0.3583 |
 
34
  ```
35
  KeyError: 'qwen2'
36
  ```
37
+ ## **Support Community**
38
+
39
+ **https://discord.gg/JsezgAf7**
40
 
41
  ## Evaluation Performance
42
+ | Model | ONET | IC | TGAT | TPAT-1 | A-Level | Average (ThaiExam) | MMLU | M3Exam | M6Exam |
43
  | :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
44
+ | OpenthaiLLM-Prebuilt-7B | **0.5493** | 0.6315 | **0.6307** | **0.4655** | **0.37** | **0.5294** | **0.7054** | **0.5705** | **0.596** |
45
+ | SeaLLM-v3-7B | 0.4753 | **0.6421** | 0.6153 | 0.3275 | 0.3464 | 0.4813 | 0.7037 | 0.4907 | 0.4625 | 0.3666 |
46
  | llama-3-typhoon-v1.5-8B | 0.3765 | 0.3473 | 0.5538 | 0.4137 | 0.2913 | 0.3965 | 0.6451 | 0.4312 | 0.4125 |
47
  | Qwen-2-7B | 0.4814 | 0.621 | 0.6153 | 0.3448 | 0.3385 | 0.4802 | 0.7073 | 0.4949 | 0.4807 |
48
  | Meta-Llama-3.1-8B | 0.3641 | 0.2631 | 0.2769 | 0.3793 | 0.1811 | 0.2929 | 0.6591 | 0.4239 | 0.3583 |