| license: mit | |
| datasets: | |
| - rxavier/economicus | |
| language: | |
| - en | |
| tags: | |
| - chatml | |
| - mistral | |
| - instruct | |
| - openhermes | |
| - economics | |
| # Taurus 1.0 | |
| ## Description | |
| Taurus is an [OpenHermes 2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) finetune using the [Economicus dataset](https://huggingface.co/datasets/rxavier/economicus), an instruct dataset synthetically generated from Economics PhD textbooks. | |
| The model was trained for 2 epochs (QLoRA) using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl). The exact config I used can be found [here](https://huggingface.co/rxavier/Taurus-1.0-Mistral-7B/tree/main/axolotl). | |
| ## Prompt format | |
| Taurus uses **ChatML**. | |
| ``` | |
| <|im_start|>system | |
| System message | |
| <|im_start|>user | |
| User message<|im_end|> | |
| <|im_start|>assistant | |
| ``` |