Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
redscv95
/
Llama-3.1-8b-cq-gguf
like
0
GGUF
English
Korean
llama
unsloth
Inference Endpoints
conversational
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.1-8b-cq-gguf
1 contributor
History:
22 commits
redscv95
(Trained with Unsloth)
2b7c8f7
verified
3 months ago
.gitattributes
1.85 kB
(Trained with Unsloth)
3 months ago
Llama-3.1-8b-cq.F16.gguf
16.1 GB
LFS
Rename unsloth.F16.gguf to Llama-3.1-8b-cq.F16.gguf
3 months ago
README.md
405 Bytes
Update README.md
3 months ago
config.json
29 Bytes
(Trained with Unsloth)
3 months ago
unsloth.BF16.gguf
16.1 GB
LFS
(Trained with Unsloth)
3 months ago
unsloth.Q4_K_M.gguf
4.92 GB
LFS
(Trained with Unsloth)
3 months ago
unsloth.Q5_K_M.gguf
5.73 GB
LFS
(Trained with Unsloth)
3 months ago
unsloth.Q8_0.gguf
8.54 GB
LFS
(Trained with Unsloth)
3 months ago
