GGUF
English
Inference Endpoints
Felladrin commited on
Commit
114104e
1 Parent(s): 7a9aa9d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - HuggingFaceH4/ultrachat_200k
5
+ language:
6
+ - en
7
+ base_model: Locutusque/TinyMistral-248M-v2-Instruct
8
+ ---
9
+
10
+ # Description
11
+ GGUF version of [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct).
12
+
13
+ # Recommended inference parameters
14
+ ```
15
+ do_sample: true
16
+ temperature: 0.1
17
+ top_p: 0.14
18
+ top_k: 12
19
+ repetition_penalty: 1.1
20
+ ```
21
+
22
+ # Recommended prompt template
23
+ ```
24
+ <|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|>
25
+ ```