Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

917

Full-text search

Active filters: roleplay

bartowski/Pantheon-RP-1.6-12b-Nemo-KTO-GGUF

Text Generation • Updated Aug 31 • 598 • 1

bartowski/Ellaria-9B-GGUF

Text Generation • Updated Aug 31 • 443 • 3

bartowski/L3-Rhaenys-8B-GGUF

Text Generation • Updated Aug 31 • 238 • 1

mradermacher/Chaifighter-20B-v3-GGUF

Updated Aug 31 • 95

mradermacher/Instant-RP-Noodles-12B-v1.2-i1-GGUF

Updated Aug 31 • 269 • 1

bartowski/Pantheon-RP-1.6-12b-Nemo-KTO-exl2

Text Generation • Updated Aug 31

mradermacher/Chaifighter-20B-v3-i1-GGUF

Updated Aug 31 • 285

Marcus-Arcadius/Chaifighter-20B-v3-Q8_0-GGUF

Text Generation • Updated Sep 1 • 10

QuantFactory/L3-Rhaenys-8B-GGUF

Updated Sep 1 • 136 • 2

lucyknada/Luni_StarDust-12b-v2-exl2

Text Generation • Updated Sep 2 • 52

mradermacher/StarDust-12b-v2-i1-GGUF

Updated Sep 1 • 771 • 3

QuantFactory/StarDust-12b-v2-GGUF

Text Generation • Updated Sep 2 • 209 • 4

ParasiticRogue/Instant-RP-Noodles-12B-v1.2-exl2-8.0

Text Generation • Updated Sep 8 • 7 • 1

riqalter/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-Q3_K_S-GGUF

Text Generation • Updated Sep 2 • 14

QuantFactory/Pantheon-RP-1.6-12b-Nemo-KTO-GGUF

Updated Sep 3 • 267 • 2

Vdr1/L3.1-8B-komorebi-v0.1-GGUF-IQ

Updated Sep 3 • 113 • 1

QuantFactory/Ellaria-9B-GGUF

Updated Sep 4 • 48 • 2

Triangle104/L3-Rhaenys-8B-Q4_K_M-GGUF

Updated Sep 4 • 10

Triangle104/L3-Rhaenys-8B-Q5_K_M-GGUF

Updated Sep 4 • 11

Triangle104/L3-Rhaenys-8B-Q6_K-GGUF

Updated Sep 4 • 10

Triangle104/L3-Rhaenys-8B-Q8_0-GGUF

Statuo/Stardust-V2-EXL2-8bpw

Text Generation • Updated Sep 5 • 10

Statuo/Stardust-V2-EXL2-6bpw

Text Generation • Updated Sep 5 • 7

Statuo/Stardust-V2-EXL2-4bpw

Text Generation • Updated Sep 5 • 10

mradermacher/ChatWaifu_v1.4-GGUF

Updated Sep 16 • 241 • 1

mradermacher/ChatWaifu_v1.4-i1-GGUF

Updated Sep 16 • 6.42k • 5

ParasiticRogue/Instant-RP-Noodles-12B-v1.3

Text Generation • Updated Sep 8 • 9 • 3

Triangle104/L3-Nymeria-8B-Q4_K_M-GGUF

Updated Sep 7 • 11

Triangle104/L3-Nymeria-8B-Q5_K_M-GGUF

Updated Sep 7 • 9

Triangle104/L3-Nymeria-8B-Q6_K-GGUF

Updated Sep 7 • 9