Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

14,716

Full-text search

Active filters: 4-bit

lucyknada/chargoddard_llama3-42b-v0-4.0bpw-EXL2

Text Generation • Updated Apr 22 • 11 • 4

RichardErkhov/EleutherAI_-_polyglot-ko-5.8b-4bits

Text Generation • Updated Apr 23 • 10 • 1

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Jun 8 • 114 • 3

ruslanmv/llama3-8B-medical

Text Generation • Updated May 15 • 190 • 9

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14 • 19 • 1

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 251 • 22

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated 17 days ago • 34.1k • 24

AbdWalidAI/Llama-3-8B-Instruct-dialogsum

Text Generation • Updated May 1 • 10 • 1

Sreenington/Llama-3-8B-ChatQA-AWQ

Text Generation • Updated May 5 • 32 • 2

liujiawu/Llama-3-8b-review-absa-4bit-v0.1

Text Generation • Updated about 1 month ago • 52 • 2

HuggingFaceM4/idefics2-8b-chatty-AWQ

Image-Text-to-Text • Updated May 6 • 11 • 4

wyseow/InternVL-Chat-V1-5-Int8-OL

Visual Question Answering • Updated May 28 • 1

openerotica/Llama-3-lima-nsfw-16k-test-GPTQ

Text Generation • Updated May 17 • 66 • 5

chansung/mental_health_counseling_merged_v0.1

Text Generation • Updated May 29 • 65 • 3

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 297k • 58

TechxGenus/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • Updated May 23 • 51 • 1

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 2.67k • 25

scb10x/llama-3-typhoon-v1.5x-70b-instruct-awq

Text Generation • Updated May 31 • 1.63k • 2

solidrust/Codestral-22B-v0.1-hf-AWQ

Text Generation • Updated 16 days ago • 941 • 2

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1 • 557 • 17

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 29 days ago • 12.1k • 37

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated 29 days ago • 622 • 22

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int4

Text Generation • Updated 29 days ago • 10.1k • 3

Qwen/Qwen2-1.5B-Instruct-AWQ

Text Generation • Updated 29 days ago • 11.1k • 7

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated 29 days ago • 216k • 19

unsloth/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • Updated 17 days ago • 14.8k • 4

unsloth/Qwen2-7B-Instruct-bnb-4bit

Text Generation • Updated 17 days ago • 8.19k • 4

unsloth/Qwen2-1.5B-bnb-4bit

Text Generation • Updated 17 days ago • 8k • 5

samim2024/Image-Text-To-Text

Image-Text-to-Text • Updated Jun 7 • 55 • 1

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7 • 227k • 2