Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,137

Full-text search

Active filters: imatrix

mradermacher/L3.1-RP-Hero-BigTalker-8B-i1-GGUF

Updated about 5 hours ago • 2

mradermacher/SeQwence-14Bv4-i1-GGUF

Updated about 5 hours ago • 2

flyingfishinwater/good_and_small_models

Updated 19 days ago • 1.76k • 2

telosnex/fllama

Updated Sep 25 • 592 • 6

Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF

Updated Oct 12 • 2.39k • 69

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 633 • 25

bartowski/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 10 • 2.52k • 5

dddump/Japanese-TextGen-Kage-v0.1-2x7B-gguf

Text Generation • Updated May 19 • 65 • 6

bartowski/Code-Llama-3-8B-GGUF

Text Generation • Updated May 7 • 500 • 8

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22 • 1.99k • 6

bartowski/Nxcode-CQ-7B-orpo-GGUF

Text Generation • Updated May 11 • 401 • 6

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 12 • 1.33k • 20

lmstudio-community/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 13 • 344 • 9

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • Updated May 15 • 610 • 2

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3 • 1.34k • 89

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 8.96k • 25

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 29.1k • 42

lmstudio-community/aya-23-8B-GGUF

Text Generation • Updated May 23 • 1.97k • 6

cognitivecomputations/dolphin-2.9.2-qwen2-72b-gguf

Updated May 29 • 2.48k • 17

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Jun 3 • 343 • 19

mradermacher/quill-72b-instruct-i1-GGUF

Updated Aug 2 • 456 • 4

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2 • 2.63k • 20

mradermacher/L3-8B-Stheno-v3.2-i1-GGUF

Updated Aug 2 • 1.75k • 10

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated Jun 5 • 746 • 10

mradermacher/JailbrokeAI-i1-GGUF

Updated Aug 2 • 455 • 1

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21 • 12.7k • 60

Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 21 • 9.7k • 167

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 1.93M • 10

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 1.91M • 9

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 7 • 310 • 13