stan-hua
/

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8

Commit History

Push folder to HuggingFace Hub

61899f9
verified

stan-hua commited on 2 days ago

Upload tokenizer

af891fe
verified

stan-hua commited on 3 days ago

Upload LlamaForCausalLM

771137b
verified

stan-hua commited on 3 days ago

initial commit

ebb4625
verified

stan-hua commited on 3 days ago