ikawrakow
/

mixtral-8x7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

mixtral-8x7b-quantized-gguf / mixtral-8x7b-q4k-medium.gguf

Commit History

Adding IQ3_XXS and fixed _M models

c60d8b0

ikawrakow commited on Jan 31

Removing broken models

422a19d

ikawrakow commited on Jan 31

Adding Mixtral quantized models

60c825d

ikawrakow commited on Jan 6