A collection of quantized LLMs in OpenVINO format
Jojo
jojo1899
·
AI & ML interests
None yet
Organizations
None yet
Collections
2
spaces
1
models
8
jojo1899/Phi-3.5-mini-instruct-onnx-int4
Updated
jojo1899/Llama-2-13b-chat-hf-onnx-int4
Updated
•
1
jojo1899/llama-3_1-8b-instruct-ov-int4
Updated
•
24
jojo1899/Llama-2-13b-chat-hf-ov-int4
Text Generation
•
Updated
•
161
jojo1899/Phi-3.5-mini-instruct-ov-int4
Updated
•
14
jojo1899/Mistral-7B-Instruct-v0.2-ov-int4
Text Generation
•
Updated
•
12
jojo1899/Phi-3-mini-128k-instruct-ov-int4
Text Generation
•
Updated
•
10
jojo1899/llama-3_1-8b-instruct-onnx-int4
Updated
datasets
None public yet