Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
bartowski
/
gemma-2-9b-it-GGUF
like
192
Text Generation
Transformers
GGUF
conversational
Inference Endpoints
License:
gemma
Model card
Files
Files and versions
Community
12
Train
Deploy
Use this model
599b2dd
gemma-2-9b-it-GGUF
1 contributor
History:
2 commits
bartowski
Llamacpp quants
599b2dd
verified
5 months ago
.gitattributes
Safe
2.93 kB
Llamacpp quants
5 months ago
README.md
Safe
8.45 kB
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ2_M.gguf
Safe
3.43 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ2_S.gguf
Safe
3.21 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ2_XS.gguf
Safe
3.07 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ3_M.gguf
Safe
4.49 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ3_XS.gguf
Safe
4.15 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ3_XXS.gguf
Safe
3.8 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-IQ4_XS.gguf
Safe
5.18 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q2_K.gguf
Safe
3.81 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q3_K_L.gguf
Safe
5.13 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q3_K_M.gguf
Safe
4.76 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q3_K_S.gguf
Safe
4.34 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q4_K_L.gguf
Safe
6.84 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q4_K_M.gguf
Safe
5.76 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q4_K_S.gguf
Safe
5.48 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q5_K_L.gguf
Safe
7.73 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q5_K_M.gguf
Safe
6.65 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q5_K_S.gguf
Safe
6.48 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q6_K.gguf
Safe
7.59 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q6_K_L.gguf
Safe
8.67 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q8_0.gguf
Safe
9.83 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-Q8_0_L.gguf
Safe
10.7 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it-f32.gguf
Safe
37 GB
LFS
Llamacpp quants
5 months ago
gemma-2-9b-it.imatrix
Safe
6.12 MB
LFS
Llamacpp quants
5 months ago