Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Rubavijayan
/
Qwen2.5-7B-Instruct-GGUF
like
0
Text Generation
Transformers
GGUF
English
qwen
chat
autoquant
custom_code
Inference Endpoints
4-bit precision
conversational
arxiv:
2309.00071
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Qwen2.5-7B-Instruct-GGUF
1 contributor
History:
3 commits
Rubavijayan
Create config.json
ccc17d9
verified
27 days ago
.gitattributes
1.65 kB
Upload folder using huggingface_hub
27 days ago
README.md
6.02 kB
Upload folder using huggingface_hub
27 days ago
config.json
968 Bytes
Create config.json
27 days ago
qwen2.5-7b-instruct.Q4_1.gguf
4.87 GB
LFS
Upload folder using huggingface_hub
27 days ago
qwen2.5-7b-instruct.bf16.gguf
15.2 GB
LFS
Upload folder using huggingface_hub
27 days ago