EmbeddedLLM/Meta-Llama-3.1-8B-Instruct-int4-sym-ov
Updated
OpenVINO GenAI
-
-
EmbeddedLLM/Phi-3-mini-4k-instruct-int4-sym-ov
Updated -
OpenVINO/Phi-3-mini-4k-instruct-int8-ov
Text Generation • Updated • 41 -
EmbeddedLLM/Phi-3-mini-128k-instruct-int4-sym-ov
Updated • 4 -
OpenVINO/Phi-3-mini-128k-instruct-int8-ov
Text Generation • Updated • 28 • 2 -
EmbeddedLLM/Phi-3-medium-4k-instruct-int4-sym-ov
Updated • 1 -
OpenVINO/Phi-3-medium-4k-instruct-int8-ov
Text Generation • Updated • 36 -
EmbeddedLLM/Phi-3-medium-128k-instruct-int4-sym-ov
Updated • 3 -
EmbeddedLLM/Qwen2-7B-Instruct-int4-sym-ov
Updated • 3 -
OpenVINO/Mistral-7B-Instruct-v0.2-int4-ov
Text Generation • Updated • 620 • 1 -
OpenVINO/Mistral-7B-Instruct-v0.2-int8-ov
Text Generation • Updated • 466 • 1 -
EmbeddedLLM/Mistral-7B-Instruct-v0.3-int4-sym-ov
Updated -
OpenVINO/open_llama_3b_v2-int8-ov
Text Generation • Updated • 468 • 1 -
OpenVINO/open_llama_7b_v2-int4-ov
Text Generation • Updated • 21 -
OpenVINO/open_llama_7b_v2-int8-ov
Text Generation • Updated • 17 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int4-ov
Text Generation • Updated • 690 -
OpenVINO/TinyLlama-1.1B-Chat-v1.0-int8-ov
Text Generation • Updated • 85 -
EmbeddedLLM/neural-chat-7b-v1-1-int4-sym-ov
Updated • 3 -
OpenVINO/neural-chat-7b-v1-1-int8-ov
Text Generation • Updated • 19 -
OpenVINO/starcoder2-15b-int4-ov
Text Generation • Updated • 20 -
OpenVINO/starcoder2-15b-int8-ov
Text Generation • Updated • 21 -
OpenVINO/persimmon-8b-chat-int4-ov
Text Generation • Updated • 27 -
OpenVINO/persimmon-8b-chat-int8-ov
Text Generation • Updated • 20 -
EmbeddedLLM/RedPajama-INCITE-Instruct-3B-v1-int4-sym-ov
Updated • 2 -
EmbeddedLLM/Llama-3.2-1B-Instruct-int4-sym-ov
Updated • 1 -
EmbeddedLLM/Llama-3.2-3B-Instruct-int4-sym-ov
Updated • 7 -
EmbeddedLLM/Llama-Guard-3-1B-int4-sym-ov
Updated • 3