|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- HuggingFaceH4/ultrachat_200k |
|
language: |
|
- en |
|
base_model: Locutusque/TinyMistral-248M-v2-Instruct |
|
--- |
|
|
|
# Description |
|
GGUF version of [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct). |
|
|
|
# Recommended inference parameters |
|
``` |
|
do_sample: true |
|
temperature: 0.1 |
|
top_p: 0.14 |
|
top_k: 12 |
|
repetition_penalty: 1.1 |
|
``` |
|
|
|
# Recommended prompt template |
|
``` |
|
<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|> |
|
``` |
