anthracite-org
/

magnum-v1-32b-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

magnum-v1-32b-gguf

2 contributors

History: 3 commits

alpindale's picture

Create README.md

8c155e1 verified 4 months ago

.gitattributes

2.07 kB

Upload folder using huggingface_hub 4 months ago
README.md

2.12 kB

Create README.md 4 months ago
magnum-32b-v1-iq2_s.gguf

10.3 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-iq3_m.gguf

14.7 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-iq4_nl.gguf

18.5 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-q4_k.gguf

19.7 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-q4_k_s.gguf

18.6 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-q5_k.gguf

23.1 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-q5_k_s.gguf

22.5 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-q6_k.gguf

26.7 GB
LFS

Upload folder using huggingface_hub 4 months ago
magnum-32b-v1-q8.gguf

34.6 GB
LFS

Upload folder using huggingface_hub 4 months ago