tensorblock
/

OLMo-7B-0424-hf-GGUF

Inference Endpoints

Model card Files Files and versions Community

OLMo-7B-0424-hf-GGUF

1 contributor

History: 3 commits

morriszms's picture

Update README.md

d75ea30 verified 18 days ago

.gitattributes

2.28 kB

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q2_K.gguf

2.62 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q3_K_L.gguf

3.69 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q3_K_M.gguf

3.39 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q3_K_S.gguf

3.04 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q4_0.gguf

3.93 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q4_K_M.gguf

4.18 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q4_K_S.gguf

3.96 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q5_0.gguf

4.76 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q5_K_M.gguf

4.9 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q5_K_S.gguf

4.76 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q6_K.gguf

5.65 GB
LFS

Upload folder using huggingface_hub 18 days ago
OLMo-7B-0424-hf-Q8_0.gguf

7.32 GB
LFS

Upload folder using huggingface_hub 18 days ago
README.md

4.6 kB

Update README.md 18 days ago