Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,631

Full-text search

Active filters: GGUF

Sri-Vigneshwar-DJ/sarvam-2b-v0.5-GGUF

Updated 7 days ago • 53

chatpdflocal/mistral-nemo-instruct-gguf

Updated 4 days ago • 132 • 5

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16 • 538

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16 • 852

HHD-QiXuan/RYS-XLarge-GGUF

Text Generation • Updated Aug 18 • 258 • 1

legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF

Text Generation • Updated Aug 17 • 1.18k • 13

legraphista/Minitron-4B-Base-GGUF

Text Generation • Updated Aug 17 • 421

legraphista/Minitron-8B-Base-GGUF

Text Generation • Updated Aug 19 • 334

Sri-Vigneshwar-DJ/hawky-ai-Qwen2-Math-72B-Instruct-GGUF

Updated Sep 19 • 24

legraphista/Llama-3.1-Storm-8B-IMat-GGUF

Text Generation • Updated Aug 20 • 1.05k

legraphista/Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • Updated Aug 20 • 596

legraphista/Mistral-NeMo-Minitron-8B-Base-IMat-GGUF

Text Generation • Updated Aug 21 • 824

jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 36

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 22 • 102

jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Aug 22 • 32

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 193

GPT4All-Community/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Sep 5 • 70

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated Aug 23 • 262 • 1

Quant-Cartel/G-COOM-9B-V0.01-iMat-GGUF

Updated Aug 26 • 135

legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • Updated Aug 25 • 321

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated Sep 6 • 601 • 1

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31 • 1.69k • 5

legraphista/xLAM-7b-r-IMat-GGUF

Text Generation • Updated Aug 31 • 732

legraphista/xLAM-8x7b-r-IMat-GGUF

Text Generation • Updated Aug 31 • 883 • 1

legraphista/xLAM-8x22b-r-IMat-GGUF

Text Generation • Updated Sep 1 • 871

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • Updated Sep 1 • 659

Sri-Vigneshwar-DJ/gemma-2-9b-marketing-content-GGUF

Updated Sep 1 • 19

Sri-Vigneshwar-DJ/hawky-ai-Salesforce-xLAM-1b-fc-r-GGUF

Updated 24 days ago • 3

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4 • 951k • 4

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 952k • 1