Upload folder using huggingface_hub
Browse files- Qwen2.5-Coder-1.5B-Instruct-Q2_K.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q3_K_L.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q3_K_M.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q3_K_S.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q4_0.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q4_K_M.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q4_K_S.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q5_0.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q5_K_M.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q5_K_S.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q6_K.gguf +2 -2
- Qwen2.5-Coder-1.5B-Instruct-Q8_0.gguf +2 -2
- README.md +18 -25
Qwen2.5-Coder-1.5B-Instruct-Q2_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e6008e2e8b0d2875018e83c87260f3d557dbbf3d79e5a5af8e1024a2173a5d7e
|
3 |
+
size 676304864
|
Qwen2.5-Coder-1.5B-Instruct-Q3_K_L.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:138e259dcf1184081bcbf02a22525f0cfaf552c1c71d87f4eadf16ce66afd9c8
|
3 |
+
size 880162784
|
Qwen2.5-Coder-1.5B-Instruct-Q3_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:1e3062701272ea70ca44647d7d39cd42a0df1db86aae8b51ab8d1d9974e28903
|
3 |
+
size 824178656
|
Qwen2.5-Coder-1.5B-Instruct-Q3_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:47c87c169f492717d80d309b3e2698175d4bca74becf502a10842a131b224720
|
3 |
+
size 760944608
|
Qwen2.5-Coder-1.5B-Instruct-Q4_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:52aa5ce202dfb33bbb62681157a41e142e1c1ba7718a1f297c304ec8dd3fbd1e
|
3 |
+
size 934954976
|
Qwen2.5-Coder-1.5B-Instruct-Q4_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8dc3bfb1d434a4aa7725b3a099eacff62207b39de5cf05f58b7b51d8abc5346e
|
3 |
+
size 986048480
|
Qwen2.5-Coder-1.5B-Instruct-Q4_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8dacb697591f60c8fb4dfe3e90f36b0218b9d956ccce868aafee9a2b2f4d1df5
|
3 |
+
size 940312544
|
Qwen2.5-Coder-1.5B-Instruct-Q5_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a18f4c487148f7cafef631574cf433bc63bede603a4b8f50eaadbaaca3efb512
|
3 |
+
size 1098729440
|
Qwen2.5-Coder-1.5B-Instruct-Q5_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:63918552e6a31075dc91fb4c0cb0126a52c4a352dc17fc06cf5fd0d4a8e38c19
|
3 |
+
size 1125050336
|
Qwen2.5-Coder-1.5B-Instruct-Q5_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:382d91a5abf23bacefd30c4b21d3b725dfedc851f3a7d899d2445d267f7658b7
|
3 |
+
size 1098729440
|
Qwen2.5-Coder-1.5B-Instruct-Q6_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9fc335473fd210849d38580fd518133dfb0e796603c69e5b5c77f0d3e7fba12e
|
3 |
+
size 1272739808
|
Qwen2.5-Coder-1.5B-Instruct-Q8_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d95c672b4c592c114c497bcb19ed1cae46d66991ad2e18959252f4373421cfb9
|
3 |
+
size 1646573024
|
README.md
CHANGED
@@ -1,17 +1,12 @@
|
|
1 |
---
|
2 |
-
|
3 |
-
license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct/blob/main/LICENSE
|
4 |
language:
|
5 |
- en
|
6 |
-
base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
|
7 |
-
pipeline_tag: text-generation
|
8 |
library_name: transformers
|
|
|
9 |
tags:
|
10 |
-
-
|
11 |
-
-
|
12 |
-
- chat
|
13 |
-
- qwen
|
14 |
-
- qwen-coder
|
15 |
- TensorBlock
|
16 |
- GGUF
|
17 |
---
|
@@ -27,13 +22,12 @@ tags:
|
|
27 |
</div>
|
28 |
</div>
|
29 |
|
30 |
-
##
|
31 |
|
32 |
-
This repo contains GGUF format model files for [
|
33 |
|
34 |
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
35 |
|
36 |
-
|
37 |
<div style="text-align: left; margin: 20px 0;">
|
38 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
39 |
Run them on the TensorBlock client using your local machine ↗
|
@@ -42,7 +36,6 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
|
|
42 |
|
43 |
## Prompt template
|
44 |
|
45 |
-
|
46 |
```
|
47 |
<|im_start|>system
|
48 |
{system_prompt}<|im_end|>
|
@@ -55,18 +48,18 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
|
|
55 |
|
56 |
| Filename | Quant type | File Size | Description |
|
57 |
| -------- | ---------- | --------- | ----------- |
|
58 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q2_K.gguf) | Q2_K | 0.
|
59 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.
|
60 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.
|
61 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.
|
62 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q4_0.gguf) | Q4_0 | 0.
|
63 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.
|
64 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.
|
65 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q5_0.gguf) | Q5_0 | 1.
|
66 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q5_K_S.gguf) | Q5_K_S | 1.
|
67 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q5_K_M.gguf) | Q5_K_M | 1.
|
68 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q6_K.gguf) | Q6_K | 1.
|
69 |
-
| [Qwen2.5-Coder-1.5B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q8_0.gguf) | Q8_0 | 1.
|
70 |
|
71 |
|
72 |
## Downloading instruction
|
|
|
1 |
---
|
2 |
+
base_model: unsloth/Qwen2.5-Coder-1.5B-Instruct
|
|
|
3 |
language:
|
4 |
- en
|
|
|
|
|
5 |
library_name: transformers
|
6 |
+
license: apache-2.0
|
7 |
tags:
|
8 |
+
- unsloth
|
9 |
+
- transformers
|
|
|
|
|
|
|
10 |
- TensorBlock
|
11 |
- GGUF
|
12 |
---
|
|
|
22 |
</div>
|
23 |
</div>
|
24 |
|
25 |
+
## unsloth/Qwen2.5-Coder-1.5B-Instruct - GGUF
|
26 |
|
27 |
+
This repo contains GGUF format model files for [unsloth/Qwen2.5-Coder-1.5B-Instruct](https://huggingface.co/unsloth/Qwen2.5-Coder-1.5B-Instruct).
|
28 |
|
29 |
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
30 |
|
|
|
31 |
<div style="text-align: left; margin: 20px 0;">
|
32 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
33 |
Run them on the TensorBlock client using your local machine ↗
|
|
|
36 |
|
37 |
## Prompt template
|
38 |
|
|
|
39 |
```
|
40 |
<|im_start|>system
|
41 |
{system_prompt}<|im_end|>
|
|
|
48 |
|
49 |
| Filename | Quant type | File Size | Description |
|
50 |
| -------- | ---------- | --------- | ----------- |
|
51 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q2_K.gguf) | Q2_K | 0.676 GB | smallest, significant quality loss - not recommended for most purposes |
|
52 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.761 GB | very small, high quality loss |
|
53 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.824 GB | very small, high quality loss |
|
54 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.880 GB | small, substantial quality loss |
|
55 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q4_0.gguf) | Q4_0 | 0.935 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
|
56 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.940 GB | small, greater quality loss |
|
57 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.986 GB | medium, balanced quality - recommended |
|
58 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q5_0.gguf) | Q5_0 | 1.099 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
|
59 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q5_K_S.gguf) | Q5_K_S | 1.099 GB | large, low quality loss - recommended |
|
60 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q5_K_M.gguf) | Q5_K_M | 1.125 GB | large, very low quality loss - recommended |
|
61 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q6_K.gguf) | Q6_K | 1.273 GB | very large, extremely low quality loss |
|
62 |
+
| [Qwen2.5-Coder-1.5B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Coder-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Coder-1.5B-Instruct-Q8_0.gguf) | Q8_0 | 1.647 GB | very large, extremely low quality loss - not recommended |
|
63 |
|
64 |
|
65 |
## Downloading instruction
|