Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,647

Full-text search

Active filters: chat

Maites/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 25

Maites/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 13

tensorblock/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 5 days ago • 239

Maites/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 9

Maites/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 8

tensorblock/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated 4 days ago • 275

tensorblock/Qwen2.5-Coder-32B-Instruct-bf16-GGUF

Text Generation • Updated 4 days ago • 285

tensorblock/magnum-v4-12b-GGUF

Text Generation • Updated 4 days ago • 260

tensorblock/calme-3.1-instruct-3b-GGUF

Text Generation • Updated 4 days ago • 219

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q4_K_S-GGUF

Text Generation • Updated 4 days ago • 19

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 26

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q5_K_S-GGUF

Text Generation • Updated 4 days ago • 24

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q5_K_M-GGUF

Text Generation • Updated 4 days ago • 19

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q6_K-GGUF

Text Generation • Updated 4 days ago • 18

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q8_0-GGUF

Text Generation • Updated 4 days ago • 21

tensorblock/calme-3.1-llamaloi-3b-GGUF

Text Generation • Updated 4 days ago • 158

tensorblock/magnum-v4-27b-GGUF

Text Generation • Updated 4 days ago • 255

tensorblock/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-GGUF

Text Generation • Updated 4 days ago • 275

blotfaba/Qwen-2.5-72B-Instruct-abliterated-v2-Q6_K.gguf

Text Generation • Updated 3 days ago • 42

tensorblock/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • Updated 3 days ago • 275

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated 1 day ago • 8

tensorblock/leniachat-qwen2-1.5B-v0-GGUF

Updated 3 days ago • 232

ashercn97/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • Updated 3 days ago • 320

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • Updated 3 days ago • 40

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated 1 day ago • 11

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-EXL2

Text Generation • Updated about 11 hours ago

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 1 day ago • 4.51k

mradermacher/QwQ-32B-Preview-i1-GGUF

Updated 3 days ago • 1.26k

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated 3 days ago • 4

apto-as/Qwen2.5-Coder-14B-Instruct-Q8_0-GGUF

Text Generation • Updated 3 days ago • 11