unsloth
/

Llama-3.2-3B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

danielhanchen commited on 6 days ago

Commit

07401d3

•

1 Parent(s): b9f0fdf

Upload folder using huggingface_hub

Files changed (6) hide show

Llama-3.2-3B-Instruct-Q2_K.gguf +2 -2
Llama-3.2-3B-Instruct-Q3_K_M.gguf +2 -2
Llama-3.2-3B-Instruct-Q4_K_M.gguf +2 -2
Llama-3.2-3B-Instruct-Q5_K_M.gguf +2 -2
Llama-3.2-3B-Instruct-Q6_K.gguf +2 -2
Llama-3.2-3B-Instruct-Q8_0.gguf +2 -2

Llama-3.2-3B-Instruct-Q2_K.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a3f501841cb20c00aea87026c9546a360be09fcba99ebbf383e5f0afc3ce71f1
-size 1358730496

 version https://git-lfs.github.com/spec/v1
+oid sha256:bded144dd167e10509cf232f737bed078b66a25c9cbaee6e5a07fa055edba605
+size 1363935296

Llama-3.2-3B-Instruct-Q3_K_M.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3e4b95ed5034b5ad8b57313fb65f5443ba2c9c8447dd288017af4357937c4eac
-size 1681954048

 version https://git-lfs.github.com/spec/v1
+oid sha256:e008bbfff69a2a9678ca94e7f73ce22981fb63febf309a71818fbac3f3d7eecc
+size 1687158848

Llama-3.2-3B-Instruct-Q4_K_M.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bae7754775c278ce6cbcb1b0adee181c78f3fef4ee952246315bbe298238e2a5
-size 2014172416

 version https://git-lfs.github.com/spec/v1
+oid sha256:12d6d8b302275e9c98e12a8692287ada1f5c4569edc1a48505ba9502acc03cf5
+size 2019377216

Llama-3.2-3B-Instruct-Q5_K_M.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:41bdbc1b63b9d0fad8342e03f37d73fc95b90e9322672b909a0a017cf7f907f9
-size 2316948736

 version https://git-lfs.github.com/spec/v1
+oid sha256:bf1d6e116278c8089957b3b28062a882bd9e7d239c778e225b769f630d7a9fea
+size 2322153536

Llama-3.2-3B-Instruct-Q6_K.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ffcaf68239fa7f26e60d7118b13065cbc1701025b79c0ec1ba581cff620b0f32
-size 2638648576

 version https://git-lfs.github.com/spec/v1
+oid sha256:d9074399cc148d1116f16c5bc485ebc587fb6e53fde8246976026b70fa44e2ca
+size 2643853376

Llama-3.2-3B-Instruct-Q8_0.gguf CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1a9ddc033274a1a242d5fc0cc95a5f3ca9e1d54f99e12960b70391bca3c2660d
-size 3416694016

 version https://git-lfs.github.com/spec/v1
+oid sha256:f34112a11b7dad74ab517dedf6dcf00d624c9adac2dc0c72c719ca0478554ef2
+size 3421898816