Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

104

Full-text search

Active filters: autoquant

Volko76/Qwen2.5-0.5B-Instruct-4.5bpw-exl2

Text Generation • Updated 9 days ago

Volko76/Qwen2.5-0.5B-Instruct-EXL2-4bits

Text Generation • Updated 9 days ago

Volko76/Qwen2.5-Coder-1.5B-Instruct-5.5bpw-exl2

Text Generation • Updated 9 days ago

HoneyBadger2989/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated 7 days ago • 187

jgchaparro/Tyros-v1.6-8B-GGUF

Updated 3 days ago • 106

Volko76/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • Updated 1 day ago • 105

Volko76/Qwen2.5-Coder-0.5B-Instruct-4.5bpw-exl2

Text Generation • Updated about 16 hours ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-1.0bpw-exl2

Text Generation • Updated about 16 hours ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-2.0bpw-exl2

Text Generation • Updated about 15 hours ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-3.0bpw-exl2

Text Generation • Updated about 15 hours ago

Volko76/Qwen2.5-Coder-0.5B-Instruct-8.0bpw-exl2

Text Generation • Updated about 15 hours ago

Volko76/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated about 15 hours ago

Volko76/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated about 13 hours ago

Volko76/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated about 13 hours ago