Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,907

Full-text search

Active filters: exl2

bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-8.0bpw-8hb-exl2

Text Generation • Updated Oct 16 • 66 • 3

Jellon/Pantheon-RP-Pure-1.6.2-22b-Small-exl2-6bpw

Updated Oct 25 • 39 • 1

MikeRoz/TheDrummer_Nautilus-70B-v0.1-5.0bpw-h6-exl2

Updated Oct 26 • 17 • 1

denru/Behemoth-123B-v1.1-5_0bpw-h6-exl2-pippa

Updated Oct 27 • 62 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-6.0bpw-h6-exl2

Updated Oct 27 • 39 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-5.0bpw-h6-exl2

Updated Oct 27 • 255 • 4

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.0bpw-h6-exl2

Updated Oct 27 • 1.04k • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-2.5bpw-h6-exl2

Updated Oct 28 • 39 • 1

waldie/Cydonia-v1.2-Magnum-v4-22B-6.5bpw-h6-exl2

Text Generation • Updated about 1 month ago • 128 • 1

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw

Text Generation • Updated 25 days ago • 22 • 1

async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw

Text Generation • Updated 22 days ago • 60 • 1

WaveCut/IlyaGusev-saiga_nemo_12b_sft_m9_d16_simpo_m21_d36-EXL2-8bpw

Updated 21 days ago • 14 • 1

waldie/EVA-Qwen2.5-32B-v0.2-4bpw-h6-exl2

Text Generation • Updated 20 days ago • 78 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.25bpw-h6-exl2

Updated 19 days ago • 66 • 2

waldie/TQ2.5-14B-Sugarquill-v1-8bpw-h8-exl2

Text Generation • Updated 18 days ago • 21 • 1

cgus/Qwen2.5-14B-Instruct-abliterated-v2-exl2

Text Generation • Updated 16 days ago • 44 • 1

openerotica/Mistral-Small-Instruct-2409-abliterated-4.5bpw-exl2

Text Generation • Updated 17 days ago • 68 • 1

async0x42/Athene-V2-Chat-exl2_3.5bpw

Text Generation • Updated 12 days ago • 28 • 1

Jellon/Athene-V2-Chat-72b-exl2-3bpw

Text Generation • Updated 12 days ago • 31 • 1

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated 11 days ago • 23 • 1

waldie/Beepo-22B-5.5bpw-h6-exl2

Updated 10 days ago • 17 • 1

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_5.0bpw

Text Generation • Updated 9 days ago • 9 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-4.0bpw-h6-exl2

Updated 9 days ago • 55 • 3

MikeRoz/mistralai_Mistral-Large-Instruct-2411-3.0bpw-h6-exl2

Updated 9 days ago • 29 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-2.5bpw-h6-exl2

Updated 9 days ago • 21 • 2

MikeRoz/mistralai_Mistral-Large-Instruct-2411-5.0bpw-h6-exl2

Updated 9 days ago • 20 • 1

waldie/Cydonia-v1.3-Magnum-v4-22B-5.5bpw-h6-exl2

Text Generation • Updated 6 days ago • 54 • 1

dakkidaze/Cydonia-22B-v1.3-4.5bpw-h6-exl2

Updated 4 days ago • 18 • 1

MikeRoz/TheDrummer_Behemoth-123B-v2.1-5.0bpw-h6-exl2

Updated 3 days ago • 20 • 1

Darkhn/Behemoth-v2.1-3.5bpw-h6-exl2

Updated 1 day ago • 3 • 1