ikawrakow
/

mistral-7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

mistral-7b-quantized-gguf

Commit History

Update README.md

da77a53

ikawrakow commited on Dec 7, 2023

Adding 2-bit and large 5-bit quants

86ea5c5

ikawrakow commited on Dec 7, 2023

Adding small 5-bit quantized models

4f5a82b

ikawrakow commited on Dec 7, 2023

Adding 4-bit k- and traditional ggml quants

c5374fb

ikawrakow commited on Dec 7, 2023

Adding 3-bit k-quants

685245d

ikawrakow commited on Dec 7, 2023

initial commit

4e1e2fe

ikawrakow commited on Dec 7, 2023