Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
hugging-quants
/
Meta-Llama-3.1-70B-Instruct-GPTQ-INT4
like
20
Follow
Hugging Quants
136
Text Generation
Transformers
Safetensors
8 languages
llama
llama-3.1
meta
autogptq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
License:
llama3.1
Model card
Files
Files and versions
Community
7
Train
Deploy
Use this model
Update the rope scaling settings for GPTQ model
#5
by
lanking
- opened
Aug 6
base:
refs/heads/main
←
from:
refs/pr/5
Discussion
Files changed
+7
-1
lanking
Aug 6
No description provided.
Update the rope scaling settings for GPTQ model
f8af7ce4
alvarobartt
changed pull request status to
merged
Aug 6
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
