Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Llama-2-7B-GPTQ
like
80
Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
gptq
arxiv:
2307.09288
License:
llama2
Model card
Files
Files and versions
Community
12
Train
Deploy
Use this model
VLLM
#6
by
rshrott
- opened
Sep 8, 2023
Discussion
rshrott
Sep 8, 2023
How to use with VLLM inference?
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
