Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

12,239

Full-text search

Active filters: bitsandbytes

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 43k • 54

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated 6 days ago • 89.2k • 131

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 6 days ago • 313k • 83

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 355 • 7

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 2.54k • 8

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 10.4k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 205 • 10

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22 • 187 • 3

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 987 • 23

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 24 • 5

Lightricks/T5-XXL-8bit

Updated Feb 29 • 16 • 3

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 153 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 565 • 172

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 10 • 1

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 87 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 74 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 2 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 6 days ago • 795k • 183

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 147 • 4

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 399 • 23

fxmeng/PiSSA-Llama-3-8B-4bit-r128-5iter

Text Generation • Updated Jun 26 • 57 • 1

themanas021/phi-3-medical-instruct-themanas

Text Generation • Updated May 7 • 71 • 4

ragibhasan/phi-3-bangla-instruct

Text Generation • Updated May 8 • 23 • 3

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated 6 days ago • 22.8k • 12

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 3k • 26

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 50 • 8

shaheerzk/text_to_sql

Text Generation • Updated Oct 25 • 136 • 1

rubenamtz0/llama-3-8b-lora-law2entity

Updated Jun 4 • 111 • 1

jihadzakki/idefics2-8b-vqarad-delta

Visual Question Answering • Updated Jun 13 • 35 • 3

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 122 • 7