Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

42

Full-text search

Active filters: exllamav2

matlok/lok-instruct-8b-llm3-exl2-8.0bpw

Text Generation • Updated Apr 20

Vikhrmodels/it-5.3-fp16-32k-EXL2

Updated Jun 13 • 1

backyardai/Yi-34B-200K-RPMerge-GGUF

Updated Jul 18 • 258 • 2

WaveCut/WoonaV1.2-9b-EXL2

Text Generation • Updated Sep 1 • 2

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated Oct 24 • 16

mradermacher/Yi-34B-200K-RPMerge-GGUF

Updated 16 days ago • 258

mradermacher/Yi-34B-200K-RPMerge-i1-GGUF

Updated 16 days ago • 673

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated 6 days ago • 35

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated 6 days ago • 6

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated 5 days ago • 6

TheMelonGod/NaturalLM-exl2

Text Generation • Updated 4 days ago • 6

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated 2 days ago • 2