Hugging Face's logo

Kquant03
/
TechxGenus-starcoder2-15b-instruct-GGUF

Text Generation
Transformers
GGUF
code
starcoder2
Inference Endpoints
Model card Files Community
Kquant03 commited on
Commit
c5eecab
•
1 Parent(s): 8fc8770

Upload 10 files

Browse files
Files changed (11) hide show
  1. .gitattributes +9 -0
  2. Starcoder2-15B-model-q2-k.gguf +3 -0
  3. Starcoder2-15B-model-q3-k-m.gguf +3 -0
  4. Starcoder2-15B-model-q3-k-s.gguf +3 -0
  5. Starcoder2-15B-model-q4-k-m.gguf +3 -0
  6. Starcoder2-15B-model-q4-k-s.gguf +3 -0
  7. Starcoder2-15B-model-q5-k-m.gguf +3 -0
  8. Starcoder2-15B-model-q5-k-s.gguf +3 -0
  9. Starcoder2-15B-model-q6-k.gguf +3 -0
  10. Starcoder2-15B-model-q8-0.gguf +3 -0
  11. ggml-model-f16.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Starcoder2-15B-model-q6-k.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Starcoder2-15B-model-q6-k.gguf filter=lfs diff=lfs merge=lfs -text
37
+ ggml-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Starcoder2-15B-model-q2-k.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Starcoder2-15B-model-q3-k-m.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Starcoder2-15B-model-q3-k-s.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Starcoder2-15B-model-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Starcoder2-15B-model-q4-k-s.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Starcoder2-15B-model-q5-k-m.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Starcoder2-15B-model-q5-k-s.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Starcoder2-15B-model-q8-0.gguf filter=lfs diff=lfs merge=lfs -text
Starcoder2-15B-model-q2-k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91f8ea23fa0a548a7ee44134cf99f46d6a752ecb1bf8ee68fbf5fbb62d9464bc
3
+ size 6192957376
Starcoder2-15B-model-q3-k-m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e055badc7bb4b69c808bb0ed62e0ad58c689cb5d70f1e43a296288181840059
3
+ size 8101038016
Starcoder2-15B-model-q3-k-s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0631ef211ae817256b3d5b32fa48ee583c96510e535c2f1f91fd72b4037ee702
3
+ size 6986467264
Starcoder2-15B-model-q4-k-m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cd2780a5c059a09be144da63726e259cac96c659fafe8b62fd18c8b83f02618
3
+ size 9860188096
Starcoder2-15B-model-q4-k-s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7ff81427d7d4785b64df1f1898584503d2132c6252db002769f57af2975b56c
3
+ size 9255716800
Starcoder2-15B-model-q5-k-m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9ca43b8a3eacc785591ecf567ecebdfbe7e2dc5301fcb2c5037645c7ead4d1f
3
+ size 11431479232
Starcoder2-15B-model-q5-k-s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7fd871dcbf9b98f2fb76e6ac780d7ab9a6bb0c1af7a15604c3888dec7adad7b
3
+ size 11022043072
Starcoder2-15B-model-q6-k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba588e173909a6268f830c3403e4be6ae6dfb6524cb86686066074c41a7f0c38
3
+ size 13100976064
Starcoder2-15B-model-q8-0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:274ce9e6bfd67e448ff414a178c07eb11c3c639056d8279f14f6cd5ea03dd852
3
+ size 16965109696
ggml-model-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfb68d46d59e1d3f4849d8398638f8c43e5ee4438b9abfda601e9b5306de5b95
3
+ size 31923046272