Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,589

Full-text search

Active filters: awq

stelterlab/Yi-Coder-9B-Chat-AWQ

Text Generation • Updated Sep 8 • 25 • 3

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15 • 10 • 1

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 22.7k • 28

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.01k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.14k • 3

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 14.1k • 6

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 13.4k • 9

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • Updated Sep 19 • 28 • 1

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 19.4k • 6

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 622 • 1

lurker18/Llama_3.1_70B_AWQ_4bit

Updated Oct 4 • 335 • 1

hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • Updated 23 days ago • 1.93k • 4

peakji/steiner-32b-preview-awq

Updated 19 days ago • 57 • 3

Guilherme34/CODER-0.5b_awq

Text Generation • Updated 20 days ago • 13 • 1

IntervitensInc/LLAMA-3_8B_Unaligned_BETA-AWQ

Updated 19 days ago • 6 • 1

VAGOsolutions/SauerkrautLM-gemma-2-9b-it-awq

Updated 18 days ago • 2.9k • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated 10 days ago • 350 • 1

AMead10/SuperNova-Medius-AWQ

Text Generation • Updated 13 days ago • 158 • 2

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 37 • 3

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 27 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 16 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 17

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 954 • 2

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 27

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 12.4k • 20

TheBloke/Llama-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 798 • 16

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 125 • 13

TheBloke/CodeLlama-13B-Python-AWQ

Text Generation • Updated Nov 9, 2023 • 19 • 2

TheBloke/CodeLlama-13B-Instruct-AWQ

Text Generation • Updated Nov 9, 2023 • 31 • 9