stan-hua
/

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-LC-SmoothQuant-RTN-W8A8 / tokenizer_config.json

Commit History

Push folder to HuggingFace Hub

61899f9
verified

stan-hua commited on 3 days ago

Upload tokenizer

af891fe
verified

stan-hua commited on 4 days ago