--- license: mit datasets: - rxavier/economicus language: - en tags: - chatml - mistral - instruct - openhermes - economics --- # Taurus 1.0 ## Description Taurus is an [OpenHermes 2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) finetune using the [Economicus dataset](https://huggingface.co/datasets/rxavier/economicus), an instruct dataset synthetically generated from Economics PhD textbooks. The model was trained for 2 epochs (QLoRA) using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl). The exact config I used can be found [here](https://huggingface.co/rxavier/Taurus-1.0-Mistral-7B/tree/main/axolotl). ## Prompt format Taurus uses **ChatML**. ``` <|im_start|>system System message <|im_start|>user User message<|im_end|> <|im_start|>assistant ```