Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,144

Full-text search

Active filters: imatrix

dreamgen/opus-v1.4-70b-llama3-gguf

Text Generation • Updated Jun 19 • 4.69k • 4

mradermacher/DeepSeek-Coder-V2-Instruct-i1-GGUF

Updated Aug 2 • 91 • 6

arcee-ai/Llama-3-SEC-Chat-GGUF

Text Generation • Updated Jun 19 • 847 • 9

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

Updated Aug 2 • 308 • 1

lmstudio-community/Qwen2-500M-Instruct-GGUF

Text Generation • Updated Jun 24 • 164 • 6

bartowski/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Text Generation • Updated Jun 24 • 1.33k • 23

bartowski/Replete-Coder-Llama3-8B-GGUF

Text Generation • Updated Jun 24 • 736 • 15

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

Updated Aug 2 • 1.25k • 12

mradermacher/L-MChat-7b-i1-GGUF

Updated Aug 2 • 196 • 1

lmstudio-community/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 16 • 8.13k • 21

grapevine-AI/gemma-2-27b-it-gguf

Updated Oct 26 • 1.34k • 12

duyntnet/Silicon-Maid-7B-imatrix-GGUF

Text Generation • Updated Jul 2 • 3.4k • 4

lmstudio-community/Phi-3.1-mini-4k-instruct-GGUF

Text Generation • Updated Aug 1 • 10.5k • 21

bartowski/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Aug 3 • 12.9k • 30

dahara1/gemma-2-27b-it-gguf-japanese-imatrix

Updated Sep 24 • 517 • 13

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

Updated Oct 20 • 1.11k • 3

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

Updated Aug 2 • 1.03k • 2

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

Updated Aug 2 • 1.19k • 3

THUDM/codegeex4-all-9b-GGUF

Text Generation • Updated Jul 15 • 1.57k • 9

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14 • 1.83k • 11

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 2.92k • 8

arcee-ai/Arcee-Scribe-GGUF

Updated Jul 17 • 245 • 11

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.78M • 5

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.79M • 33

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated 26 days ago • 21.6k • 47

bartowski/Arcee-Nova-GGUF

Text Generation • Updated Jul 19 • 252 • 4

bartowski/turbcat-instruct-72b-GGUF

Text Generation • Updated Jul 22 • 239 • 2

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2 • 555 • 5

bartowski/gemma-2-9b-it-abliterated-GGUF

Text Generation • Updated Oct 7 • 6.06k • 22

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2 • 7.27k • 6