numen-tech's picture
Add weights
a1b4b14
metadata
license: mit
base_model: microsoft/Phi-3.5-mini-instruct
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of Phi-3.5-mini-instruct.