Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
ikawrakow
/
mistral-7b-quantized-gguf
like
5
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
main
mistral-7b-quantized-gguf
/
mistral-7b-q40.gguf
Commit History
Adding 4-bit k- and traditional ggml quants
c5374fb
ikawrakow
commited on
Dec 7, 2023
ikawrakow
commited on
