Hugging Face's logo

Mozilla
/
rocket-3B-llamafile

Transformers
llamafile
English
stablelm
Model card Files Community
rocket-3B-llamafile

Commit History

Quantize rocket-3B with llamafile-0.7.3 Q3_K_S
652960e
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q2_K
620e437
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q5_1
8c8d5f0
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q5_0
0787e12
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q4_1
5502620
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 BF16
7bc461c
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 F16
839652d
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q8_0
9b2cc1c
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q5_K_M
62b9300
verified

jartine commited on

Quantize rocket-3B with llamafile-0.7.3 Q4_0
79ddf2f
verified

jartine commited on

Wrap rocket-3b.Q8_0.gguf with llamafile v0.6.2
77b6dd4
verified

jartine commited on

Wrap rocket-3b.Q6_K.gguf with llamafile v0.6.2
5541c07
verified

jartine commited on

Wrap rocket-3b.Q5_K_S.gguf with llamafile v0.6.2
64bb73d
verified

jartine commited on

Wrap rocket-3b.Q5_K_M.gguf with llamafile v0.6.2
3f19702
verified

jartine commited on

Wrap rocket-3b.Q5_0.gguf with llamafile v0.6.2
45473d0
verified

jartine commited on

Wrap rocket-3b.Q4_K_S.gguf with llamafile v0.6.2
b758f0a
verified

jartine commited on

Wrap rocket-3b.Q4_K_M.gguf with llamafile v0.6.2
fa33638
verified

jartine commited on

Wrap rocket-3b.Q4_0.gguf with llamafile v0.6.2
a8865ba
verified

jartine commited on

Wrap rocket-3b.Q3_K_S.gguf with llamafile v0.6.2
386424d
verified

jartine commited on

Wrap rocket-3b.Q3_K_M.gguf with llamafile v0.6.2
4375950
verified

jartine commited on

Wrap rocket-3b.Q3_K_L.gguf with llamafile v0.6.2
ffeee52
verified

jartine commited on

Wrap rocket-3b.Q2_K.gguf with llamafile v0.6.2
9bd1ca0
verified

jartine commited on

Wrap rocket-3b.Q8_0.gguf with llamafile v0.6.1
b10396a
verified

jartine commited on

Wrap rocket-3b.Q6_K.gguf with llamafile v0.6.1
7531b3d
verified

jartine commited on

Wrap rocket-3b.Q5_K_S.gguf with llamafile v0.6.1
20d77c9
verified

jartine commited on

Wrap rocket-3b.Q5_K_M.gguf with llamafile v0.6.1
e658e18
verified

jartine commited on

Wrap rocket-3b.Q5_0.gguf with llamafile v0.6.1
1d03ae6
verified

jartine commited on

Wrap rocket-3b.Q4_K_S.gguf with llamafile v0.6.1
69ff6e8
verified

jartine commited on

Wrap rocket-3b.Q4_K_M.gguf with llamafile v0.6.1
c5db398
verified

jartine commited on

Wrap rocket-3b.Q4_0.gguf with llamafile v0.6.1
331afd6
verified

jartine commited on

Wrap rocket-3b.Q3_K_S.gguf with llamafile v0.6.1
f1837c1
verified

jartine commited on

Wrap rocket-3b.Q3_K_M.gguf with llamafile v0.6.1
fd19e0a
verified

jartine commited on

Wrap rocket-3b.Q3_K_L.gguf with llamafile v0.6.1
3f99deb
verified

jartine commited on

Wrap rocket-3b.Q2_K.gguf with llamafile v0.6.1
77794de
verified

jartine commited on

Wrap rocket-3b.Q8_0.gguf with llamafile v0.6.0
642f086

jartine commited on

Wrap rocket-3b.Q6_K.gguf with llamafile v0.6.0
b6be3c2

jartine commited on

Wrap rocket-3b.Q5_K_S.gguf with llamafile v0.6.0
f17eefe

jartine commited on

Wrap rocket-3b.Q5_K_M.gguf with llamafile v0.6.0
c6e2f30

jartine commited on

Wrap rocket-3b.Q5_0.gguf with llamafile v0.6.0
68b0c21

jartine commited on

Wrap rocket-3b.Q4_K_S.gguf with llamafile v0.6.0
c1a2f52

jartine commited on

Wrap rocket-3b.Q4_K_M.gguf with llamafile v0.6.0
0f59ae2

jartine commited on

Wrap rocket-3b.Q4_0.gguf with llamafile v0.6.0
0cde774

jartine commited on

Wrap rocket-3b.Q3_K_S.gguf with llamafile v0.6.0
671eb06

jartine commited on

Wrap rocket-3b.Q3_K_M.gguf with llamafile v0.6.0
6df97e1

jartine commited on

Wrap rocket-3b.Q3_K_L.gguf with llamafile v0.6.0
20cd53d

jartine commited on

Wrap rocket-3b.Q2_K.gguf with llamafile v0.6.0
754c3c9

jartine commited on

Add rocket-3b.Q8_0.gguf to repo using llamafile ef83e2b9b22407486580dbaa4ef1a0789db6ee71
57cc838

jartine commited on

Add rocket-3b.Q6_K.gguf to repo using llamafile ef83e2b9b22407486580dbaa4ef1a0789db6ee71
8f1b5e1

jartine commited on

Add rocket-3b.Q5_K_S.gguf to repo using llamafile ef83e2b9b22407486580dbaa4ef1a0789db6ee71
8cdd35b

jartine commited on

Add rocket-3b.Q5_K_M.gguf to repo using llamafile ef83e2b9b22407486580dbaa4ef1a0789db6ee71
77ea5b1

jartine commited on