Hugging Face's logo

meta-llama
/
Meta-Llama-3-70B-Instruct

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-3
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
70

AWQ Quantization?

#10
by cbML - opened
Discussion
cbML

When awq quantized model???

Payoto

https://huggingface.co/casperhansen/llama-3-70b-instruct-awq

Sign up or log in to comment