File size: 792 Bytes
3e57ff7 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
license: mit
datasets:
- rxavier/economicus
language:
- en
tags:
- chatml
- mistral
- instruct
- openhermes
- economics
---
# Taurus 1.0
## Description
Taurus is an [OpenHermes 2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) finetune using the [Economicus dataset](https://huggingface.co/datasets/rxavier/economicus), an instruct dataset synthetically generated from Economics PhD textbooks.
The model was trained for 2 epochs (QLoRA) using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl). The exact config I used can be found [here](https://huggingface.co/rxavier/Taurus-1.0-Mistral-7B/tree/main/axolotl).
## Prompt format
Taurus uses **ChatML**.
```
<|im_start|>system
System message
<|im_start|>user
User message<|im_end|>
<|im_start|>assistant
``` |