Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,132

Full-text search

Active filters: imatrix

bartowski/QwQ-32B-Preview-GGUF

Text Generation • Updated 3 days ago • 36.8k • 37

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 4 days ago • 26

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 117k • 84

bartowski/LLaMA-Mesh-GGUF

Text Generation • Updated 11 days ago • 2.48k • 13

bartowski/Qwen2.5.1-Coder-7B-Instruct-GGUF

Text Generation • Updated 24 days ago • 70.9k • 63

bartowski/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated 12 days ago • 8.17k • 19

bartowski/EVA-Qwen2.5-72B-v0.2-GGUF

Text Generation • Updated 8 days ago • 1.98k • 4

bartowski/Behemoth-123B-v2.2-GGUF

Text Generation • Updated 6 days ago • 2.86k • 4

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 17.2k • 17

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Oct 8 • 125k • 67

bartowski/Ministral-8B-Instruct-2410-GGUF

Text Generation • Updated Oct 21 • 18.3k • 23

Lewdiculous/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

Updated Oct 22 • 2.91k • 8

bartowski/Llama-3.1-70B-ArliAI-RPMax-v1.3-GGUF

Text Generation • Updated 10 days ago • 1.91k • 5

mradermacher/Cakrawala-8B-i1-GGUF

Updated 2 days ago • 1.37k • 3

mradermacher/QwQ-32B-Preview-jackterated-i1-GGUF

Updated about 19 hours ago • 496 • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 1.92M • 65

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Sep 3 • 12k • 120

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22 • 57.8k • 20

Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

Updated Oct 24 • 11.9k • 9

bartowski/aya-expanse-8b-GGUF

Text Generation • Updated Oct 24 • 10.7k • 22

bartowski/EVA-Qwen2.5-14B-v0.2-GGUF

Text Generation • Updated 22 days ago • 5.22k • 6

bartowski/Athene-V2-Chat-GGUF

Text Generation • Updated 16 days ago • 8.5k • 12

bartowski/Qwen2.5-72B-0.6x-Instruct-GGUF

Text Generation • Updated 14 days ago • 972 • 4

bartowski/Qwen2.5-Gutenberg-Doppel-32B-GGUF

Text Generation • Updated 11 days ago • 1.71k • 2

bartowski/Llama-3.1-Tulu-3-70B-DPO-GGUF

Text Generation • Updated 9 days ago • 1.26k • 2

mradermacher/Qwen2.5-7B-HomerAnvita-NerdMix-i1-GGUF

Updated 8 days ago • 1.17k • 4

mradermacher/Qwen2.5-7B-HomerCreative-Mix-i1-GGUF

Updated 8 days ago • 905 • 3

mradermacher/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-i1-GGUF

Updated 5 days ago • 1.19k • 2

mradermacher/Tulu-3.1-8B-SuperNova-i1-GGUF

Updated 5 days ago • 808 • 2

mradermacher/Ice0.41-22.11-RP-i1-GGUF

Updated 5 days ago • 464 • 3