GGUF small language models
Collection
LMs of 8B parameters or less. Quantized in 8bit and 4bit representations, and converted to GGUF.
•
29 items
•
Updated
jxtngx/Llama-Guard-3-8B-Q8_0-GGUF
This model was converted to GGUF format from meta-llama/Llama-Guard-3-8B using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
- Downloads last month
- 8
Inference API (serverless) is not available, repository is disabled.