Hugging Face's logo

llmware
/
dreamgen-wizardlm-2-7b-ov

OpenVINO
mistral
green
p7
llmware-chat
ov
Model card Files Community
Edit model card

dreamgen-wizardlm-2-7b-ov

dreamgen-wizardlm-2-7b-ov is an OpenVino int4 quantized version of Dreamgen's popular Wizard finetune of Mistral, providing a fast inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

dreamgen-wizardlm-2-7b is a leading chat finetuned version of Mistral 7b.

Model Description

  • Developed by: dreamgen
  • Quantized by: llmware
  • Model type: mistral-7b
  • Parameters: 7 billion
  • Model Parent: dreamgen/wizardlm-2-7b
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: General purpose chat
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on hf

llmware website

Downloads last month
16
Inference API
Inference API (serverless) has been turned off for this model.

Model tree for llmware/dreamgen-wizardlm-2-7b-ov

Base model

dreamgen/WizardLM-2-7B
Quantized
(4)
this model

Collection including llmware/dreamgen-wizardlm-2-7b-ov