Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,634

Full-text search

Active filters: imatrix

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 976k • 60

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 8.43k • 25

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 4.51k • 42

lmstudio-community/aya-23-8B-GGUF

Text Generation • Updated May 23 • 1.87k • 6

legraphista/Phi-3-medium-128k-instruct-IMat-GGUF

Text Generation • Updated May 26 • 543 • 2

mradermacher/L3-SnowStorm-v1.15-4x8B-B-i1-GGUF

Updated Aug 2 • 750 • 3

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Jun 3 • 279 • 19

legraphista/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF

Text Generation • Updated Jun 1 • 2.96k • 2

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2 • 3.2k • 19

mradermacher/L3-8B-Stheno-v3.2-i1-GGUF

Updated Aug 2 • 1.83k • 10

Lewdiculous/Rawr_Llama3_8B-GGUF-IQ-Imatrix

Updated Jun 6 • 504 • 5

mradermacher/JailbrokeAI-i1-GGUF

Updated Aug 2 • 1.16k • 1

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21 • 14.1k • 60

Qwen/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 17 • 3.46k • 30

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 1.24M • 8

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7 • 461 • 5

Lewdiculous/Average_Normie_v3.69_8B-GGUF-IQ-Imatrix

Updated Jun 8 • 198 • 14

mradermacher/L3-SthenoMaidBlackroot-8B-V1-i1-GGUF

Updated Aug 2 • 311 • 7

bartowski/Hathor-L3-8B-v.02-GGUF

Text Generation • Updated Jun 10 • 1.01k • 16

mradermacher/dolphin-2.9.2-qwen2-72b-i1-GGUF

Updated Aug 2 • 2.51k • 2

duyntnet/pygmalion-2-7b-imatrix-GGUF

Text Generation • Updated Jun 13 • 422 • 1

mradermacher/L3-70B-Euryale-v2.1-i1-GGUF

Updated Aug 2 • 1.74k • 21

Lewdiculous/llama3-8B-DarkIdol-1.0-GGUF-IQ-Imatrix-Request

Updated Jun 17 • 520 • 6

dreamgen/opus-v1.4-70b-llama3-gguf

Text Generation • Updated Jun 19 • 390 • 4

mradermacher/DeepSeek-Coder-V2-Instruct-i1-GGUF

Updated Aug 2 • 53 • 6

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20 • 1.7k • 4

bartowski/DeepSeek-Coder-V2-Instruct-GGUF

Text Generation • Updated Jun 23 • 362 • 27

mradermacher/Hermes-2-Theta-Llama-3-70B-i1-GGUF

Updated Aug 2 • 600 • 1

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

Updated Aug 2 • 308 • 1

mradermacher/Llama3-Sophie-i1-GGUF

Updated Aug 2 • 921 • 1