stan-hua
/

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W4A16-KV8 / model-00001-of-00002.safetensors

Commit History

Push folder to HuggingFace Hub

7a22a6b
verified

stan-hua commited on 2 days ago