Hugging Face's logo

hugging-quants
/
Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation
Transformers
Safetensors
8 languages
llama
llama-3.1
meta
autoawq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
15
Meta-Llama-3.1-70B-Instruct-AWQ-INT4
  • 6 contributors
 History: 13 commits
alvarobartt's picture
alvarobartt HF staff
Xenova's picture
Xenova HF staff
Improve installation + code snippets (#2)
438694b verified