Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,692

Full-text search

Active filters: 4-bit

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 987 • 23

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 5.58k • 49

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 24 • 5

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 153 • 9

ZySec-AI/ZySec-7B-AWQ

Text Generation • Updated Mar 20 • 9 • 1

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 565 • 172

ilsp/Meltemi-7B-Instruct-v1-AWQ

Text Generation • Updated Apr 8 • 27 • 6

wasertech/assistant-dolphin-2.2.1-mistral-7b-e1-awq

Text Generation • Updated 30 days ago • 36 • 2

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 87 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 74 • 54

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 1.9M • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 65.7k • 124

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 497 • 12

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 67.2k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 131k • 165

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 1.97M • 77

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated 6 days ago • 795k • 183

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 901 • 18

leliuga/Meta-Llama-Guard-2-8B-bnb-4bit

Text Generation • Updated Apr 19 • 14 • 1

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 29 • 6

SweatyCrayfish/llama-3-8b-quantized

Text Generation • Updated Apr 20 • 735 • 10

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3 • 25 • 4

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 147 • 4

MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF

Text Generation • Updated Apr 24 • 52 • 4

MaziyarPanahi/Llama-3-8B-Instruct-DPO-v0.1-GGUF

Text Generation • Updated Apr 25 • 1.59M • 2

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 399 • 23

fxmeng/PiSSA-Llama-3-8B-4bit-r128-5iter

Text Generation • Updated Jun 26 • 57 • 1

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23 • 2.13k • 7

ragibhasan/phi-3-bangla-instruct

Text Generation • Updated May 8 • 23 • 3

nm-testing/Llama-2-7b-pruned2.4-Marlin_24

Text Generation • Updated May 15 • 1.11k • 1