Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,928

Full-text search

Active filters: awq

PrunaAI/mistralai-Mistral-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 7

rubra-ai/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Jul 4 • 6

ravi-wcg/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 4 • 6

ravi-wcg/Llama-3-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 4 • 4

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4 • 35 • 1

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4 • 4

Weni/ZeroShot-Agents-Llama3-4.0.47-SFT-AWQ

Text Generation • Updated Jul 4 • 9

Weni/ZeroShot-Agents-Llama3-4.0.48-SFT-AWQ

Text Generation • Updated Jul 5 • 5

Weni/ZeroShot-Agents-Llama3-4.0.49-DPO-AWQ

Text Generation • Updated Jul 5 • 5

ellamind/qwen2-72b-instruct-awq-de

Text Generation • Updated Jul 22 • 5

emaibb/magnum-72b-v1-awq

Text Generation • Updated Jul 5 • 8 • 3

Weni/ZeroShot-Agents-Llama3-4.0.50-SFT-AWQ

Text Generation • Updated Jul 5 • 5

elysiantech/gemma-2b-awq-4bit

Text Generation • Updated Jul 5 • 4

elysiantech/phi-3-mini-4k-instruct-awq-4bit

Text Generation • Updated Jul 6 • 10

Weni/ZeroShot-Agents-Llama3-4.0.52-SFT-AWQ

Text Generation • Updated Jul 6 • 5

Weni/ZeroShot-Agents-Llama3-4.0.53-SFT-AWQ

Text Generation • Updated Jul 6 • 3

Weni/ZeroShot-Agents-Llama3-4.0.54-SFT-AWQ

Text Generation • Updated Jul 6 • 5

Weni/ZeroShot-Agents-Llama3-4.0.55-SFT-AWQ

Text Generation • Updated Jul 7 • 8

pankajmathur/orca_mini_v7_7b-AWQ

Text Generation • Updated Jul 7 • 5 • 1

pankajmathur/orca_mini_v6_8b-AWQ

Text2Text Generation • Updated Jul 7 • 3 • 1

pankajmathur/orca_mini_v6_8b_dpo-AWQ

Text2Text Generation • Updated Jul 7 • 3 • 1

Weni/ZeroShot-Agents-Llama3-4.0.56-SFT-AWQ

Text Generation • Updated Jul 7 • 8

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-AWQ

Text Generation • Updated Jul 7 • 6

solidrust/dolphin-2.9.3-mistral-7B-32k-AWQ

Text Generation • Updated Sep 3 • 9

shunran/L3-ChaoticSoliloquy-v1.5-4x8B-awq

Text Generation • Updated Jul 8 • 5

nihaomur/Llama-3-Taiwan-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 19 • 8 • 1

solidrust/Phi-3-mini-128k-instruct-AWQ

Text Generation • Updated Sep 3 • 123 • 1

solidrust/Phi-3-mini-4k-instruct-AWQ

Text Generation • Updated Sep 3 • 18

Weni/ZeroShot-Agents-Llama3-4.0.58-SFT-AWQ

Text Generation • Updated Jul 8 • 7

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-140-AWQ

Text Generation • Updated Jul 8 • 5