Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,068

Full-text search

Active filters: chat

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.13k • 1

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 996 • 2

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.5k • 3

bartowski/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated 1 day ago • 19.3k • 21

lmstudio-community/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 1.19k • 1

lmstudio-community/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 19 • 625

lmstudio-community/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 1.3k

Qwen/Qwen2-7B-Instruct-MLX

Text Generation • Updated Sep 18 • 519 • 1

paultimothymooney/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 18 • 23

paultimothymooney/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 18 • 13

mlx-community/Qwen2.5-0.5B-Instruct-bf16

Text Generation • Updated Sep 18 • 28

mlx-community/Qwen2.5-0.5B-Instruct-8bit

Text Generation • Updated Sep 18 • 40

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Sep 18 • 474

mlx-community/Qwen2.5-1.5B-Instruct-bf16

Text Generation • Updated Sep 18 • 22

mlx-community/Qwen2.5-1.5B-Instruct-8bit

Text Generation • Updated Sep 18 • 21

mlx-community/Qwen2.5-1.5B-Instruct-4bit

Text Generation • Updated Sep 18 • 647

bartowski/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 1.12k

lmstudio-community/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 245

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 558

mlx-community/Qwen2.5-3B-Instruct-bf16

Text Generation • Updated Sep 18 • 24

mlx-community/Qwen2.5-3B-Instruct-8bit

Text Generation • Updated Sep 18 • 29

mlx-community/Qwen2.5-3B-Instruct-4bit

Text Generation • Updated Sep 18 • 117

mlx-community/Qwen2.5-14B-Instruct-bf16

Text Generation • Updated Sep 18 • 36 • 1

mlx-community/Qwen2.5-14B-Instruct-8bit

Text Generation • Updated Sep 18 • 119 • 1

mlx-community/Qwen2.5-7B-Instruct-bf16

Text Generation • Updated Sep 18 • 36

mlx-community/Qwen2.5-7B-Instruct-4bit

Text Generation • Updated 3 days ago • 348 • 1

mlx-community/Qwen2.5-32B-Instruct-bf16

Text Generation • Updated Sep 18 • 32

mlx-community/Qwen2.5-Math-7B-Instruct-4bit

Text Generation • Updated Sep 18 • 55

mlx-community/Qwen2.5-Math-1.5B-Instruct-4bit

Text Generation • Updated Sep 18 • 20

CalamitousFelicitousness/Qwen2.5-0.5B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18 • 15