Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

8,310

Full-text search

Active filters: llama-cpp

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated 4 days ago • 3.63k • 25

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

Updated 9 days ago • 770 • 12

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 69.2k • 40

pcuenq/Qwen2.5-0.5B-Instruct-with-new-merges-serialization-Q8_0-GGUF

Text Generation • Updated Sep 30 • 50 • 2

openerotica/writing-roleplay-20k-context-nemo-12b-v1.0-gguf

Updated 25 days ago • 6.15k • 14

Orion-zhen/Meissa-Qwen2.5-14B-Instruct-Q6_K-GGUF

Updated 16 days ago • 317 • 2

CultriX/Qwen2.5-14B-MegaMerge-pt2-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 58 • 2

DavidAU/StoryWeaver-7b-Instruct-v0.1-Q6_K-GGUF

Updated Apr 10 • 14 • 2

DavidAU/Mistral-7B-Neural-Story-mix-Q6_K-GGUF

Updated Apr 10 • 10 • 1

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9 • 5.79k • 12

DavidAU/DistiLabelOrca-TinyLLama-1.1B-Q8_0-GGUF

Question Answering • Updated Apr 20 • 19 • 2

hus960/Llama-3-8b.UNLEASHED-Q4_K_M-GGUF

Text Generation • Updated Apr 23 • 14 • 2

DevsDoCode/LLama-3-8b-Uncensored-Q5_K_S-GGUF

Text Generation • Updated May 6 • 68 • 2

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 939 • 50

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 2.16k • 50

Lanerdog/Llama-3-8B-Instruct-Gradient-1048k-Q5_K_M-GGUF

Text Generation • Updated May 21 • 7 • 1

AlirezaF138/Llama-3-Persian-8B-LoRA-Q6_K-GGUF

Updated May 22 • 17 • 5

Ayyystin/sexyGPT-Uncensored-Q4_0-GGUF

Updated Jun 7 • 831 • 2

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12 • 87 • 4

sunzx0810/gte-Qwen2-7B-instruct-Q5_K_M-GGUF

Sentence Similarity • Updated Jun 25 • 395 • 6

mobeetle/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Jun 20 • 14 • 1

Johnyquest7/medllama3-v20-Q4_K_M-GGUF

Updated Jun 22 • 23 • 2

elyza/Llama-3-ELYZA-JP-8B-GGUF

Updated Jun 26 • 59.8k • 40

joaquinito2073/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

Updated Jul 1 • 27 • 1

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3 • 46 • 2

v000000/SwallowMaid-8B-L3-SPPO-abliterated-Q8_0-GGUF

Updated Jul 11 • 44 • 2

mtsdurica/madlad400-3b-mt-Q4_K_M-GGUF

Translation • Updated Jul 13 • 7.35k • 3

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15 • 108 • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

Updated Aug 28 • 190 • 3

ooff123/lawyer-llama-13b-v2-Q4_K_M-GGUF

Updated Jul 26 • 43 • 2