Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,402

Full-text search

Active filters: 5-bit

MaziyarPanahi/calme-2.8-qwen2-7b-GGUF

Text Generation • Updated Jul 21 • 330 • 2

blockblockblock/Llama-3-Instruct-8B-SPPO-Iter3-bpw5-exl2

Text Generation • Updated Jun 28 • 4

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_5.0bpw_h8

Text Generation • Updated Jun 29 • 2

blockblockblock/Arcee-Spark-bpw5-exl2

Text Generation • Updated Jun 30 • 2

blockblockblock/NuExtract-bpw5-exl2

Text Generation • Updated Jul 1 • 282

blockblockblock/Tess-v2.5-Phi-3-medium-128k-14B-bpw5-exl2

Text Generation • Updated Jul 2 • 5

kim512/Llama-3-70b-Arimas-story-RP-V2.1-5.0bpw-h6-exl2

Text Generation • Updated Jul 5 • 7

blockblockblock/Llama3-8B-Instruct-Replete-Adapted-bpw5-exl2

Text Generation • Updated Jul 5 • 2

blockblockblock/calm3-22b-chat-bpw5-exl2

Text Generation • Updated Jul 6 • 38

XelotX/WizardLM-2-8x22B-XelotX-iQuants

Text Generation • Updated Jul 12 • 21

bullerwins/Big-Tiger-Gemma-27B-v1-exl2_5.0bpw

Text Generation • Updated Jul 14 • 12

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 952k • 6

bullerwins/mathstral-7B-v0.1-exl2_5.0bpw

Text Generation • Updated Jul 16 • 5

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 179 • 5

DrNicefellow/Mistral-Nemo-Instruct-2407-exl2-5bpw

Text Generation • Updated Jul 18 • 14

Natkituwu/L3-8B-Celeste-V1.2-exl2-5.0bpw

Text Generation • Updated Jul 20 • 2

blockblockblock/shanty-9b-bpw5-exl2

Text Generation • Updated Jul 21 • 2

Natkituwu/mistral-dory-12b-5.0bpw-exl2

Text Generation • Updated Jul 21 • 2

blockblockblock/SmolLM-1.7B-Instruct-bpw5-exl2

Text Generation • Updated Jul 22 • 4

MaziyarPanahi/SmolLM-135M-Instruct-GGUF

Text Generation • Updated Jul 22 • 314 • 2

MaziyarPanahi/SmolLM-360M-Instruct-GGUF

Text Generation • Updated Jul 22 • 195 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-GGUF

Text Generation • Updated Jul 22 • 412 • 4

Natkituwu/mistral-doryV2-12b-5.0bpw-exl2

Text Generation • Updated Jul 22 • 9

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23 • 952k • 14

bullerwins/Meta-Llama-3.1-8B-Instruct-exl2_5.0bpw

Text Generation • Updated Aug 23 • 40 • 1

LoneStriker/Meta-Llama-3.1-8B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jul 24 • 4

LoneStriker/Meta-Llama-3.1-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jul 24 • 2

MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 26 • 19.7k • 20

Annuvin/dolphin-2.9.3-mistral-nemo-12b-5.0bpw-exl2

Text Generation • Updated Jul 24 • 2 • 1

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_5.0bpw

Text Generation • Updated Aug 23 • 14