jojo1899
/

Mistral-7B-Instruct-v0.2-ov-int4

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.2-ov-int4 / generation_config.json

Commit History

Improved quantization using Openvino 2024.5.0rc1

dcf0b7b

jojo1899 commited on 7 days ago

Quantized using nncf 2.13.0

d7dcec5

jojo1899 commited on 8 days ago

Initial commit

9d32f69
verified

jojo1899 commited on Jun 7