GGUFd https://huggingface.co/Maykeye/TinyLLama-v0

Download

pip install huggingface-hub

From CLI:

huggingface-cli download \
aladar/TinyLLama-v0-GGUF \
TinyLLama-v0.Q8_0.gguf \
--local-dir . \
--local-dir-use-symlinks False
Downloads last month
62
GGUF
Model size
4.62M params
Architecture
llama

8-bit

16-bit

32-bit

Inference Examples
Unable to determine this model's library. Check the docs .