jojo1899
/

Llama-2-13b-chat-hf-ov-int4

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-2-13b-chat-hf-ov-int4

Commit History

Improved quantization using Openvino 2024.5.0rc1

0869f09

jojo1899 commited on 6 days ago

Removing older openvino-tokenizers files

0ace247

jojo1899 commited on 7 days ago

Quantized using nncf 2.13.0

397e787
verified

jojo1899 commited on 7 days ago

Added nncf, torch, and transformers package versions

85c391d
verified

jojo1899 commited on Jun 7

Updated README.md

b7da369
verified

jojo1899 commited on Jun 7

Initial commit

47a3717
verified

jojo1899 commited on Jun 7

initial commit

3605700
verified

jojo1899 commited on Jun 7