Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,575

Full-text search

Active filters: 4-bit

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 3 days ago • 6.74k • 8

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 14 days ago • 315k • 59

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated 3 days ago • 17 • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 27 days ago • 5.41k • 21

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.87k • 15

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 276k • 51

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 80.4k • 73

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 14 days ago • 12.1k • 21

pzc163/MiniCPMv2_6-prompt-generator

Updated 24 days ago • 1.37k • 27

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated about 3 hours ago • 6.71k • 17

unsloth/Reflection-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 8 days ago • 1.77k • 13

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 6.16k • 19

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 2.98k • 162

lucyknada/chargoddard_llama3-42b-v0-4.0bpw-EXL2

Text Generation • Updated Apr 22 • 8 • 4

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 12.6k • 25

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 52.9k • 10

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 6 days ago • 9.16k • 19

openbmb/MiniCPM-V-2_6-int4

Visual Question Answering • Updated Aug 8 • 15k • 51

arcee-ai/deepseek-v2-chat-0628-awq

Updated about 1 month ago • 33 • 5

speakleash/Bielik-11B-v2.2-Instruct-GPTQ

Text Generation • Updated 20 days ago • 492 • 3

speakleash/Bielik-11B-v2.2-Instruct-AWQ

Text Generation • Updated 20 days ago • 124 • 3

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 9 days ago • 11.5k • 16

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated 10 days ago • 4.21k • 9

openbmb/MiniCPM3-4B-GPTQ-Int4

Text Generation • Updated 11 days ago • 1.01k • 10

stelterlab/Yi-Coder-9B-Chat-AWQ

Text Generation • Updated 9 days ago • 105 • 2

TeeZee/Reflection-Llama-3.1-70B-bpw4.0-h8-exl2

Updated 7 days ago • 9 • 2

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated 6 days ago • 51 • 2

ParasiticRogue/Magnum-Instruct-DPO-12B-exl2-4.0

Text Generation • Updated 4 days ago • 10 • 2

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 7.57k • 313

TheBloke/airoboros-13B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 91 • 37