seyf1elislam
commited on
Commit
•
77a9def
1
Parent(s):
5cfa89c
Update README.md
Browse files
README.md
CHANGED
@@ -67,6 +67,18 @@ Replicate the configuration utilized in the [froggeric/WestLake-10.7B-v2](https:
|
|
67 |
# Quantized versions :
|
68 |
- [**GGUF**](https://huggingface.co/seyf1elislam/WestKunai-Hermes-10.7b-test-GGUF)
|
69 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
70 |
## Merge Details
|
71 |
|
72 |
|
|
|
67 |
# Quantized versions :
|
68 |
- [**GGUF**](https://huggingface.co/seyf1elislam/WestKunai-Hermes-10.7b-test-GGUF)
|
69 |
|
70 |
+
# comparison
|
71 |
+
| Metric | diff |Current(10.7b)|Origin(7b)|
|
72 |
+
|---------------------------------|----:|----:|----:|
|
73 |
+
|Avg. |<span style="color:red">-3.76</span>|69.75|73.51|
|
74 |
+
|AI2 Reasoning Challenge (25-Shot)|<span style="color:red">-3.07</span>|68.09|71.16|
|
75 |
+
|HellaSwag (10-Shot) |<span style="color:red">-0.66</span>|87.10|87.76|
|
76 |
+
|MMLU (5-Shot) |<span style="color:red">-0.34</span>|64.43|64.77|
|
77 |
+
|TruthfulQA (0-shot) |<span style="color:red">-0.97</span>|64.28|65.25|
|
78 |
+
|Winogrande (5-shot) |<span style="color:red">-0.31</span>|82.72|83.03|
|
79 |
+
|GSM8k (5-shot) |<span style="color:red">-17.21</span>|51.86|69.07|
|
80 |
+
|
81 |
+
|
82 |
## Merge Details
|
83 |
|
84 |
|