File size: 535 Bytes
114104e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: apache-2.0
datasets:
- HuggingFaceH4/ultrachat_200k
language:
- en
base_model: Locutusque/TinyMistral-248M-v2-Instruct
---
# Description
GGUF version of [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct).
# Recommended inference parameters
```
do_sample: true
temperature: 0.1
top_p: 0.14
top_k: 12
repetition_penalty: 1.1
```
# Recommended prompt template
```
<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|>
``` |