teddylee777 commited on
Commit
93c230f
β€’
1 Parent(s): 65b6917

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -17,6 +17,27 @@ pipeline_tag: text-generation
17
 
18
  ## πŸ’¬ Template
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
  ## πŸ§‘β€πŸ’» Helpful Contents
22
  - βœ… [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)
 
17
 
18
  ## πŸ’¬ Template
19
 
20
+ ```
21
+ FROM Qwen2.5-7B-Instruct-kowiki-qa-context-Q8_0.gguf
22
+
23
+ TEMPLATE """{{- if .System }}
24
+ <|im_start|>system
25
+ {{ .System }}
26
+ <|im_end|>
27
+ {{- end }}
28
+ <|im_start|>user
29
+ {{ .Prompt }}
30
+ <|im_end|>
31
+ <|im_start|>assistant
32
+ """
33
+
34
+ SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄λ‘œ ν•΄μ£Όμ„Έμš”."""
35
+
36
+ PARAMETER temperature 0
37
+ PARAMETER num_ctx 128000
38
+ PARAMETER stop <|im_start|>
39
+ PARAMETER stop <|im_end|>
40
+ ```
41
 
42
  ## πŸ§‘β€πŸ’» Helpful Contents
43
  - βœ… [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)