Hugging Face's logo

solidrust
/
Mixtral-3x7B-Instruct-v0.1-AWQ

Text Generation
Transformers
Safetensors
mixtral
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card Files Community
Edit model card

fxmeng/Mixtral-3x7B-Instruct-v0.1 AWQ

Model Summary

Author does not provide details

Downloads last month
9
Safetensors
Model size
2.7B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Model tree for solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ

Base model

fxmeng/Mixtral-3x7B-Instruct-v0.1
Quantized
this model

Collection including solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ