uukuguy
/

Mistral-7B-OpenOrca-lora-merged

Text Generation

Model card Files Files and versions Community

uukuguy commited on Oct 18, 2023

Commit

8a8e476

•

1 Parent(s): 191e859

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -47,7 +47,8 @@ The source code is [here](https://github.com/uukuguy/multi_loras)
 | | ARC_acc_norm (25-shot) | HellaSwag_acc_norm (10-shot) | MMLU_acc (5-shot) | TruthfulQA_mc2 (0-shot) | GSM8K_acc (8-shot) | Open LLM Score |
 | ------ | ------ | ------ | ------ | ------ | ------ | ------ |
 | Mistral-7B-OpenOrca | **71** | 83 | 61.42 | 45 | 40 | 65.11 |
-| **r=64** | 67 | 84 | **64.26** | **47.32** | **41** | **65.65** |
 | *r=16* | *65* | *83* | *62.84* | *46.95* | *38* | *64.45* |
 ### Open LLM Leaderboard

 | | ARC_acc_norm (25-shot) | HellaSwag_acc_norm (10-shot) | MMLU_acc (5-shot) | TruthfulQA_mc2 (0-shot) | GSM8K_acc (8-shot) | Open LLM Score |
 | ------ | ------ | ------ | ------ | ------ | ------ | ------ |
 | Mistral-7B-OpenOrca | **71** | 83 | 61.42 | 45 | 40 | 65.11 |
+| **r=256** | 68 | **84** | **64.28** | 46.953 | **41** |  **65.81** |
+| r=64 | 67 | 84 | 64.26 | **47.32** | **41** | 65.65 |
 | *r=16* | *65* | *83* | *62.84* | *46.95* | *38* | *64.45* |
 ### Open LLM Leaderboard