Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
granite-3.1-1b-a400m-instruct-i1-GGUF
like
0
Transformers
GGUF
English
language
granite-3.1
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
e130da9
granite-3.1-1b-a400m-instruct-i1-GGUF
1 contributor
History:
4 commits
mradermacher
uploaded from rich1
e130da9
verified
17 days ago
.gitattributes
Safe
3.34 kB
uploaded from rich1
17 days ago
README.md
Safe
249 Bytes
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ1_M.gguf
Safe
331 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ1_S.gguf
Safe
303 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ2_M.gguf
Safe
462 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ2_S.gguf
Safe
425 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ2_XS.gguf
Safe
416 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ2_XXS.gguf
Safe
378 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ3_M.gguf
Safe
610 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ3_S.gguf
Safe
598 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ3_XS.gguf
Safe
568 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ3_XXS.gguf
Safe
530 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-IQ4_XS.gguf
Safe
728 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q2_K.gguf
Safe
512 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q2_K_S.gguf
Safe
479 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q3_K_L.gguf
Safe
711 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q3_K_M.gguf
Safe
659 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q3_K_S.gguf
Safe
598 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q4_0.gguf
Safe
771 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q4_K_M.gguf
Safe
822 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q4_K_S.gguf
Safe
775 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q5_K_M.gguf
Safe
956 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q5_K_S.gguf
Safe
929 MB
LFS
uploaded from rich1
17 days ago
granite-3.1-1b-a400m-instruct.i1-Q6_K.gguf
Safe
1.1 GB
LFS
uploaded from rich1
17 days ago
imatrix.dat
8.36 MB
LFS
uploaded from rich1
17 days ago
