Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,583

Full-text search

Active filters: chat

tensorblock/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 2 days ago • 217

Maites/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 2

Maites/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 5

tensorblock/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated 1 day ago • 234

tensorblock/Qwen2.5-Coder-32B-Instruct-bf16-GGUF

Text Generation • Updated 1 day ago • 225

tensorblock/magnum-v4-12b-GGUF

Text Generation • Updated 1 day ago • 228

tensorblock/calme-3.1-instruct-3b-GGUF

Text Generation • Updated 1 day ago • 205

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q4_K_S-GGUF

Text Generation • Updated 1 day ago • 17

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 17

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q5_K_S-GGUF

Text Generation • Updated 1 day ago • 17

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q5_K_M-GGUF

Text Generation • Updated 1 day ago • 17

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q6_K-GGUF

Text Generation • Updated 1 day ago • 17

Triangle104/Qwen2.5-14B-Instruct-abliterated-Q8_0-GGUF

Text Generation • Updated 1 day ago • 17

tensorblock/calme-3.1-llamaloi-3b-GGUF

Text Generation • Updated 1 day ago • 126

tensorblock/magnum-v4-27b-GGUF

Text Generation • Updated 1 day ago • 204

tensorblock/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-GGUF

Text Generation • Updated 1 day ago • 210

blotfaba/Qwen-2.5-72B-Instruct-abliterated-v2-Q6_K.gguf

Text Generation • Updated about 4 hours ago • 26

tensorblock/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • Updated about 12 hours ago

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated about 8 hours ago

tensorblock/leniachat-qwen2-1.5B-v0-GGUF

Updated about 7 hours ago

mlx-community/QwQ-32B-Preview-4bit

Text Generation • Updated about 4 hours ago

mlx-community/QwQ-32B-Preview-3bit

Text Generation • Updated about 3 hours ago

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated about 3 hours ago

ashercn97/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • Updated about 5 hours ago

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • Updated about 4 hours ago

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated about 4 hours ago

mradermacher/SD-Prompter-1.5B-V0.1-GGUF

Updated about 2 hours ago

mradermacher/SD-Prompter-1.5B-V0.1-i1-GGUF

Updated about 2 hours ago

mradermacher/QwQ-32B-Preview-i1-GGUF

Updated 17 minutes ago

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated about 1 hour ago