fbaldassarri
/

meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-asym

Text Generation

intel-autoround

text-generation-inference

8-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-asym

1 contributor

History: 3 commits

fbaldassarri's picture

Update README.md

1e02d58 verified about 17 hours ago