Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,737

Full-text search

Active filters: quantized

argmaxinc/whisperkit-coreml

Automatic Speech Recognition • Updated 14 days ago • 142k • 96

qualcomm/Posenet-Mobilenet-Quantized

Keypoint Detection • Updated 12 minutes ago • 3

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.83M • 6

MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF

Text Generation • Updated 29 days ago • 317 • 3

afrideva/malaysian-tinyllama-1.1b-16k-instructions-GGUF

Text Generation • Updated Nov 12, 2023 • 91 • 2

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 117 • 3

afrideva/zephyr-smol_llama-100m-sft-full-GGUF

Text Generation • Updated Nov 28, 2023 • 2.11k • 3

afrideva/malaysian-mistral-1.1B-4096-GGUF

Text Generation • Updated Nov 29, 2023 • 123 • 2

afrideva/tiny-llama-1.1b-chat-medical-GGUF

Text Generation • Updated Dec 1, 2023 • 180 • 5

MaziyarPanahi/MetaMath-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 180 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 5.58k • 49

Lewdiculous/Kunocchini-7b-128k-test-GGUF-Imatrix

Text Generation • Updated May 4 • 902 • 29

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30 • 23

qualcomm/Llama-v2-7B-Chat

Text Generation • Updated 15 days ago • 24

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4 • 3.34k • 36

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated 9 days ago • 62

Lewdiculous/Layris_9B-GGUF-IQ-Imatrix

Text Generation • Updated May 4 • 407 • 17

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 560 • 25

Lewdiculous/Model-Requests

Updated Sep 9 • 38

Lewdiculous/RP_Vision_7B-GGUF-IQ-Imatrix

Updated Mar 23 • 513 • 6

ilsp/Meltemi-7B-Instruct-v1-AWQ

Text Generation • Updated Apr 8 • 27 • 6

Lewdiculous/Nyanade_Stunna-Maid-7B-v0.2-GGUF-IQ-Imatrix

Updated May 4 • 1.52k • 47

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15 • 1.9M • 74

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 65.7k • 124

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 497 • 12

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 67.2k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 131k • 165

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 1.97M • 77

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 901 • 18

MaziyarPanahi/Poppy_Porpoise-v0.6-L3-8B-GGUF

Text Generation • Updated Apr 24 • 52 • 4