feihu.hf
commited on
Commit
•
828a2ec
1
Parent(s):
3bb4097
update README
Browse files
README.md
CHANGED
@@ -54,14 +54,15 @@ Since cloning the entire repo may be inefficient, you can manually download the
|
|
54 |
```
|
55 |
2. Download:
|
56 |
```shell
|
57 |
-
huggingface-cli download Qwen/Qwen2.5-7B-Instruct-GGUF qwen2.5-7b-instruct-
|
|
|
58 |
```
|
59 |
-
For large files, we split them into multiple segments due to the limitation of file upload. They share a prefix, with a suffix indicating its index. For examples, `qwen2.5-7b-instruct-q5_k_m-00001-of-00002.gguf` and `qwen2.5-7b-instruct-q5_k_m-00002-of-00002.gguf`. You need to download all of them.
|
60 |
3. (Optional) Merge:
|
61 |
For split files, you need to merge them first with the command `llama-gguf-split` as shown below:
|
62 |
```bash
|
63 |
# ./llama-gguf-split --merge <first-split-file-path> <merged-file-path>
|
64 |
-
./llama-gguf-split --merge qwen2.5-7b-instruct-q5_k_m-00001-of-00002.gguf qwen2.5-7b-instruct-q5_k_m.gguf
|
65 |
```
|
66 |
|
67 |
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
|
|
|
54 |
```
|
55 |
2. Download:
|
56 |
```shell
|
57 |
+
huggingface-cli download Qwen/Qwen2.5-Coder-7B-Instruct-GGUF --include "qwen2.5-coder-7b-instruct-q5_k_m*.gguf" --local-dir . --local-dir-use-symlinks False
|
58 |
+
|
59 |
```
|
60 |
+
For large files, we split them into multiple segments due to the limitation of file upload. They share a prefix, with a suffix indicating its index. For examples, `qwen2.5-coder-7b-instruct-q5_k_m-00001-of-00002.gguf` and `qwen2.5-coder-7b-instruct-q5_k_m-00002-of-00002.gguf`. You need to download all of them.
|
61 |
3. (Optional) Merge:
|
62 |
For split files, you need to merge them first with the command `llama-gguf-split` as shown below:
|
63 |
```bash
|
64 |
# ./llama-gguf-split --merge <first-split-file-path> <merged-file-path>
|
65 |
+
./llama-gguf-split --merge qwen2.5-coder-7b-instruct-q5_k_m-00001-of-00002.gguf qwen2.5-coder-7b-instruct-q5_k_m.gguf
|
66 |
```
|
67 |
|
68 |
For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
|