4-bit OmniQuant quantized version of Phi-3.5-mini-instruct.
- Downloads last month
- 0
Inference API (serverless) is not available, repository is disabled.
Model tree for numen-tech/Phi-3.5-mini-instruct-w4a16g128asym
Base model
microsoft/Phi-3.5-mini-instruct
Quantized
this model