dranger003
/

airoboros-34b-3.2-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

airoboros-34b-3.2-iMat.GGUF

1 contributor

History: 17 commits

dranger003's picture

Update README.md

7be081e verified 8 months ago

.gitattributes

2.16 kB

Upload ggml-airoboros-34b-3.2-iq2_s.gguf 8 months ago
README.md

5.99 kB

Update README.md 8 months ago
ggml-airoboros-34b-3.2-iq2_m.gguf

11.8 GB
LFS

Upload ggml-airoboros-34b-3.2-iq2_m.gguf 8 months ago
ggml-airoboros-34b-3.2-iq2_s.gguf

10.9 GB
LFS

Upload ggml-airoboros-34b-3.2-iq2_s.gguf 8 months ago
ggml-airoboros-34b-3.2-iq2_xs.gguf

10.3 GB
LFS

Upload ggml-airoboros-34b-3.2-iq2_xs.gguf 8 months ago
ggml-airoboros-34b-3.2-iq3_m.gguf

15.6 GB
LFS

Upload ggml-airoboros-34b-3.2-iq3_m.gguf 8 months ago
ggml-airoboros-34b-3.2-iq3_s.gguf

15 GB
LFS

Upload ggml-airoboros-34b-3.2-iq3_s.gguf 8 months ago
ggml-airoboros-34b-3.2-iq3_xs.gguf

14.2 GB
LFS

Upload ggml-airoboros-34b-3.2-iq3_xs.gguf 8 months ago
ggml-airoboros-34b-3.2-iq4_xs.gguf

18.5 GB
LFS

Upload ggml-airoboros-34b-3.2-iq4_xs.gguf 8 months ago
ggml-airoboros-34b-3.2-q8_0-imatrix.dat

15.3 MB
LFS

Upload ggml-airoboros-34b-3.2-q8_0-imatrix.dat 8 months ago
ggml-airoboros-34b-3.2-q8_0.gguf

36.5 GB
LFS

Upload ggml-airoboros-34b-3.2-q8_0.gguf 8 months ago