Hugging Face's logo

QuietImpostor
/
OpenELM-3B-Instruct-GGUFs

GGUF
English
Inference Endpoints
Model card Files Community
QuietImpostor commited on
Commit
1ff4ed8
•
1 Parent(s): 625e71d

Upload iMatrix quants / forgotten quants

Browse files
Files changed (14) hide show
  1. .gitattributes +13 -0
  2. OpenELM-3B-Instruct-F32.gguf +3 -0
  3. OpenELM-3B-Instruct-IQ1_M.gguf +3 -0
  4. OpenELM-3B-Instruct-IQ1_S.gguf +3 -0
  5. OpenELM-3B-Instruct-IQ2_M.gguf +3 -0
  6. OpenELM-3B-Instruct-IQ2_S.gguf +3 -0
  7. OpenELM-3B-Instruct-IQ2_XS.gguf +3 -0
  8. OpenELM-3B-Instruct-IQ2_XXS.gguf +3 -0
  9. OpenELM-3B-Instruct-Q2_K.gguf +3 -0
  10. OpenELM-3B-Instruct-Q2_K_S.gguf +3 -0
  11. OpenELM-3B-Instruct-Q4_0.gguf +3 -0
  12. OpenELM-3B-Instruct-Q4_1.gguf +3 -0
  13. OpenELM-3B-Instruct-Q5_0.gguf +3 -0
  14. OpenELM-3B-Instruct-Q5_1.gguf +3 -0
.gitattributes CHANGED
@@ -50,3 +50,16 @@ OpenELM-3B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
  OpenELM-3B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
  OpenELM-3B-Instruct-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
52
  OpenELM-3B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  OpenELM-3B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
  OpenELM-3B-Instruct-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
52
  OpenELM-3B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
53
+ OpenELM-3B-Instruct-F32.gguf filter=lfs diff=lfs merge=lfs -text
54
+ OpenELM-3B-Instruct-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ OpenELM-3B-Instruct-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ OpenELM-3B-Instruct-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ OpenELM-3B-Instruct-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ OpenELM-3B-Instruct-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
59
+ OpenELM-3B-Instruct-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
60
+ OpenELM-3B-Instruct-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
61
+ OpenELM-3B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
62
+ OpenELM-3B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
63
+ OpenELM-3B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
64
+ OpenELM-3B-Instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
65
+ OpenELM-3B-Instruct-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
OpenELM-3B-Instruct-F32.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bd50aaa0923213e31cead5a9f65947ce5965a523dcb81ee49106bfe64e58cbf
3
+ size 12147333440
OpenELM-3B-Instruct-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cfe8e3bd7c9b69420a24f88ea908c4a5ec34ce9da4e45a7613c680911fea7cd
3
+ size 726350368
OpenELM-3B-Instruct-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:679ab9141ac2f30c23c360fd6dba0d83a150d4e8fd1e576a8c326e6c30a47a1f
3
+ size 664455712
OpenELM-3B-Instruct-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c2cfbd9065a560cc19c19761a02a29e3c1df6ccd9afbeaa3fabcc0e50ad4c7d
3
+ size 1042889248
OpenELM-3B-Instruct-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b12857693df4dab07f9e1da8cece4f6dc903fec4d010f553137032b854d274a
3
+ size 960363040
OpenELM-3B-Instruct-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c356e0d1852aadffc8a3c99805c6b7124441c6c185beeb0680f2741afab6699d
3
+ size 920095264
OpenELM-3B-Instruct-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e2fe376d23ae9a3bc7f8ed4717b0e208fbbb9c827dbd0c25830d827bc242918
3
+ size 829508128
OpenELM-3B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4346a22a3a70a6e342599a0c52108cca2d9e063166aff3f1239041fa40849264
3
+ size 1150218784
OpenELM-3B-Instruct-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff2a89ab43861b964c61140f94c27709d91facaa529c95305aff892035504720
3
+ size 1055601184
OpenELM-3B-Instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de8acb9280d1a40b86da4d8082166f3f11be165201bc1b1645c075d39d30ef88
3
+ size 1735004480
OpenELM-3B-Instruct-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:996f1f07bbb769a586d61cd47b8cc45a12fdc0d0a61be83a9d4bef3ffb21b0f0
3
+ size 1918636352
OpenELM-3B-Instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2244042f0191724bb1a364b6af1f6a68e11bd7441e3aa4f98498c25c87fe1f2
3
+ size 2102268224
OpenELM-3B-Instruct-Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e78a4a8ecdd7710f647c3fe6fb3d71dbd742b325589cf2ebf873c4d2984f534
3
+ size 2285900096