-
-
-
-
-
-
Inference status
Active filters:
4-bit
TheBloke/Chronoboros-33B-GPTQ
Text Generation
•
Updated
•
53
•
28
TheBloke/Llama-2-7B-GPTQ
Text Generation
•
Updated
•
18.1k
•
80
TheBloke/Llama-2-70B-Chat-GPTQ
Text Generation
•
Updated
•
12.1k
•
259
TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ
Text Generation
•
Updated
•
22
•
25
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
Updated
•
6.14k
•
181
TheBloke/CodeLlama-7B-Instruct-GPTQ
Text Generation
•
Updated
•
149k
•
44
clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
•
63
•
9
TheBloke/Phind-CodeLlama-34B-v2-GPTQ
Text Generation
•
Updated
•
176
•
89
casperhansen/opt-125m-awq
Text Generation
•
Updated
•
82
•
2
TheBloke/Mythalion-13B-AWQ
Text Generation
•
Updated
•
11.6k
•
10
TheBloke/WizardLM-7B-uncensored-AWQ
Text Generation
•
Updated
•
38
•
3
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
393
•
26
TheBloke/Mistral-7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
92.4k
•
35
TheBloke/Mistral-7B-OpenOrca-AWQ
Text Generation
•
Updated
•
6.23k
•
41
TheBloke/Mistral-7B-OpenOrca-GPTQ
Text Generation
•
Updated
•
80.2k
•
100
TheBloke/llava-v1.5-13B-AWQ
Text Generation
•
Updated
•
186
•
31
TheBloke/LLaMA2-13B-Tiefighter-AWQ
Text Generation
•
Updated
•
295
•
37
TheBloke/AquilaChat2-34B-16K-AWQ
Text Generation
•
Updated
•
9
•
4
TheBloke/AquilaChat2-34B-16K-GPTQ
Text Generation
•
Updated
•
11
•
6
TheBloke/Yarn-Mistral-7B-128k-AWQ
Text Generation
•
Updated
•
766
•
69
TheBloke/Yarn-Mistral-7B-128k-GPTQ
Text Generation
•
Updated
•
50
•
13
TheBloke/goliath-120b-AWQ
Text Generation
•
Updated
•
24
•
10
unsloth/llama-2-7b-bnb-4bit
Text Generation
•
Updated
•
9.55k
•
8
TheBloke/deepseek-llm-67b-chat-GPTQ
Text Generation
•
Updated
•
8
•
5
TheBloke/OpenHermes-2.5-neural-chat-7B-v3-2-7B-AWQ
Text Generation
•
Updated
•
31
•
5
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
•
135
•
96
casperhansen/mixtral-instruct-awq
Text Generation
•
Updated
•
108k
•
42
TheBloke/Aurora-Nights-70B-v1.0-AWQ
Text Generation
•
Updated
•
6
•
4
TheBloke/Nous-Hermes-2-SOLAR-10.7B-AWQ
Text Generation
•
Updated
•
57
•
10
mlx-community/Mistral-7B-Instruct-v0.1-4bit-mlx
Text Generation
•
Updated
•
44
•
1