stan-hua
/

Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-LC-SmoothQuant-GPTQ-W8A8 / config.json

Commit History

Push folder to HuggingFace Hub

6be81e5
verified

stan-hua commited on 2 days ago

Upload LlamaForCausalLM

3412278
verified

stan-hua commited on 3 days ago