Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

16,826

Full-text search

Active filters: 4-bit

lucyknada/NeverSleep_Lumimaid-v0.2-12B-exl2-4.0bpw

Text Generation • Updated Jul 26 • 19 • 1

shuyuej/bge-en-icl-GPTQ

Feature Extraction • Updated Jul 29 • 59 • 1

shuyuej/bge-multilingual-gemma2-GPTQ

Feature Extraction • Updated Jul 29 • 191 • 4

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3 • 7.52k • 13

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated about 1 month ago • 19.4k • 25

zero-systems/Artemis-Extactor-70B-4bit-gptq-v1

Updated Sep 6 • 1 • 1

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • Updated Sep 3 • 127 • 3

PrunaAI/THUDM-LongWriter-glm4-9b-bnb-4bit-smashed

Updated Aug 16 • 12 • 2

SicariusSicariiStuff/Dusk_Rainbow-EXL2-4.0-bpw

Updated Aug 17 • 15 • 1

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 7 • 6

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 969k • 7

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 16 • 1

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 955k • 4

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Aug 20 • 77.4k • 10

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23 • 131 • 6

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.31k • 34

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 1.1k • 2

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 147 • 3

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-GPTQ-4bit

Text Generation • Updated Sep 3 • 285 • 1

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-GPTQ-4bit

Text Generation • Updated Sep 3 • 285 • 2

cmarkea/CodeLlama-34b-Instruct-hf-4bit

Text Generation • Updated Sep 19 • 15 • 1

cmarkea/Meta-Llama-3.1-70B-Instruct-4bit

Text Generation • Updated Sep 19 • 75 • 1

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 170k • 37

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 49.2k • 21

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 8.06k • 15

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 11.9k • 14

alexwww94/glm-4v-9b-gptq-4bit

Updated Sep 9 • 300 • 5

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29 • 504 • 1

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Sep 4 • 90 • 7

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 199 • 11