Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,928

Full-text search

Active filters: awq

peakji/steiner-32b-preview-awq

Updated Oct 21 • 14 • 3

VAGOsolutions/SauerkrautLM-gemma-2-9b-it-awq

Updated Oct 22 • 257 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated about 1 month ago • 1.88k • 1

Orion-zhen/aya-expanse-32b-AWQ

Text Generation • Updated Oct 27 • 858 • 1

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • Updated 25 days ago • 2.95k • 2

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 12 days ago • 2.58k • 3

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated 12 days ago • 4.27k • 2

Qwen/Qwen2.5-Coder-0.5B-Instruct-AWQ

Text Generation • Updated 12 days ago • 366 • 1

Orion-zhen/OpenCoder-8B-Instruct-AWQ

Text Generation • Updated 19 days ago • 117 • 1

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated 19 days ago • 545 • 4

FractalGPT/RuQwen2.5-3B-Instruct-AWQ

Text Generation • Updated 17 days ago • 938 • 5

Alannikos768/BanterBot-7b-chat-w4a16-4bit

Updated 17 days ago • 11 • 1

Alannikos768/BanterBot_1_8b-chat-w4a16-4bit

Updated 17 days ago • 9 • 1

Alannikos768/BoostBot_1_8b-chat-w4a16-4bit

Updated 17 days ago • 9 • 1

Alannikos768/BoostBot-7b-chat-w4a16-4bit

Updated 17 days ago • 6 • 1

radm/Athene-V2-Chat-AWQ

Text Generation • Updated 12 days ago • 203 • 3

pomelk1n/RuadaptQwen2.5-32B-instruct-4-bit-AWQ-GEMM

Text Generation • Updated 10 days ago • 116 • 1

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated 1 day ago • 104 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 28 • 3

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 17 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 18 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 17

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 427 • 2

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 101

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 4.59k • 20

TheBloke/Llama-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 6.86k • 16

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 162 • 13

TheBloke/CodeLlama-13B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 14 • 2

TheBloke/CodeLlama-13B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 205 • 9