-
-
-
-
-
-
Inference status
Active filters:
awq
stelterlab/Yi-Coder-9B-Chat-AWQ
Text Generation
•
Updated
•
25
•
3
jfiekdjdk/glm-4-9b-chat-awq
Qwen/Qwen2-VL-72B-Instruct-AWQ
Image-Text-to-Text
•
Updated
•
22.7k
•
28
Qwen/Qwen2.5-1.5B-Instruct-AWQ
Text Generation
•
Updated
•
2.01k
•
3
Qwen/Qwen2.5-3B-Instruct-AWQ
Text Generation
•
Updated
•
2.14k
•
3
Qwen/Qwen2.5-7B-Instruct-AWQ
Text Generation
•
Updated
•
14.1k
•
6
Qwen/Qwen2.5-14B-Instruct-AWQ
Text Generation
•
Updated
•
13.4k
•
9
solidrust/LLama-3.1-8B-Matrix-AWQ
Text Generation
•
Updated
•
28
•
1
Qwen/Qwen2.5-Coder-7B-Instruct-AWQ
Text Generation
•
Updated
•
19.4k
•
6
joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4
lurker18/Llama_3.1_70B_AWQ_4bit
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
•
Updated
•
1.93k
•
4
peakji/steiner-32b-preview-awq
Updated
•
57
•
3
Guilherme34/CODER-0.5b_awq
Text Generation
•
Updated
•
13
•
1
IntervitensInc/LLAMA-3_8B_Unaligned_BETA-AWQ
Updated
•
6
•
1
VAGOsolutions/SauerkrautLM-gemma-2-9b-it-awq
Updated
•
2.9k
•
1
ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4
Text Generation
•
Updated
•
350
•
1
AMead10/SuperNova-Medius-AWQ
Text Generation
•
Updated
•
158
•
2
casperhansen/mpt-7b-8k-chat-awq
Text Generation
•
Updated
•
37
•
3
casperhansen/vicuna-7b-v1.5-awq
Text Generation
•
Updated
•
27
•
3
casperhansen/vicuna-7b-v1.5-awq-gemv
Text Generation
•
Updated
•
16
•
1
casperhansen/mpt-7b-8k-chat-awq-gemv
Text Generation
•
Updated
•
17
casperhansen/opt-125m-awq
Text Generation
•
Updated
•
954
•
2
casperhansen/tinyllama-1b-awq
Text Generation
•
Updated
•
27
Bomml/Llama-2-70B-chat-w4-g128-awq
Text Generation
•
Updated
TheBloke/Llama-2-7B-Chat-AWQ
Text Generation
•
Updated
•
12.4k
•
20
TheBloke/Llama-2-7B-AWQ
Text Generation
•
Updated
•
798
•
16
TheBloke/Llama-2-13B-AWQ
Text Generation
•
Updated
•
125
•
13
TheBloke/CodeLlama-13B-Python-AWQ
Text Generation
•
Updated
•
19
•
2
TheBloke/CodeLlama-13B-Instruct-AWQ
Text Generation
•
Updated
•
31
•
9