pipilok commited on
Commit
7c0030a
1 Parent(s): e90ccee

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/blob/main/LICENSE
4
+ language:
5
+ - en
6
+ pipeline_tag: text-generation
7
+ base_model: Qwen/Qwen2.5-7B
8
+ tags:
9
+ - chat
10
+ library_name: transformers
11
+ quantized_by: pipilok
12
+ ---
13
+
14
+ Original model: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct
15
+
16
+ Tested on Snapdragon X Elite with LM Studio 0.3.2 ARM64 Technology Preview https://lmstudio.ai/snapdragon
17
+
18
+ Avg answer Speed: 17 tok/s
19
+
20
+ ## LM Studio Settings:
21
+ ```
22
+ Before System: <|im_start|>system\n
23
+ After System: <|im_end|>\n
24
+ Before User: <|im_start|>user\n
25
+ After User: <|im_end|>\n
26
+ Before Assistant: <|im_start|>assistant\n
27
+ After Assistant: <|im_end|>\n
28
+ ```