File size: 751 Bytes
e3bf463 1a6f95e e3bf463 eb07e3c 6907ab2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
license: cc-by-nc-4.0
tags:
- merge
---
Merge of [KoboldAI/LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2) and [NeverSleep/Noromaid-13b-v0.1.1](https://huggingface.co/NeverSleep/Noromaid-13b-v0.1.1)
.yaml file for mergekit
```
models:
- model: LLaMA2-13B-Psyfighter2
- model: Noromaid-13b-v0.1.1
parameters:
density: 0.65
weight: [0, 0.3, 0.7, 1]
merge_method: ties
base_model: LLaMA2-13B-Psyfighter2
parameters:
normalize: true
int8_mask: true
dtype: float16
```
| Metric | Value |
| --- | --- |
| Avg. | 59.47 |
| ARC (25-shot) | 61.86 |
| HellaSwag (10-shot) | 84.58 |
| MMLU (5-shot) | 57.04 |
| TruthfulQA (0-shot) | 50.66 |
| Winogrande (5-shot) | 75.37 |
| GSM8K (5-shot) | 27.29 | |