Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
4-bit precision
AutoTrain Compatible
text-generation-inference
Inference Endpoints
custom_code
Merge
8-bit precision
Eval Results
Mixture of Experts
text-embeddings-inference
Carbon Emissions
Apply filters
Models
14,674
Full-text search
Edit filters
Sort: Trending
Active filters:
4-bit
Clear all
TheBloke/Kunoichi-7B-AWQ
Text Generation
•
Updated
Jan 5
•
13
•
8
TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ
Text Generation
•
Updated
Jan 16
•
993
•
26
pandasai/bamboo-llm
Text Generation
•
Updated
Jan 17
•
444
•
11
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
Updated
8 days ago
•
15.8k
•
29
TheBloke/CodeLlama-70B-Python-AWQ
Text Generation
•
Updated
Jan 31
•
76
•
5
Qwen/Qwen1.5-14B-Chat-AWQ
Text Generation
•
Updated
Apr 30
•
26.4k
•
21
Tann-dev/sex-chat-dirty-girlfriend
Text Generation
•
Updated
Feb 17
•
473
•
16
unsloth/gemma-7b-bnb-4bit
Text Generation
•
Updated
16 days ago
•
15k
•
17
sayakpaul/gemma-2b-sft-qlora-no-robots
Updated
Mar 20
•
1
areegtarek/idefics-9b-instruct-all-v2
Updated
Mar 24
•
1
explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ
Text Generation
•
Updated
Apr 8
•
161
•
10
ikeno-ada/m2m100_418-mt-bitsandbytes-4bit
Translation
•
Updated
Apr 7
•
40
•
1
CohereForAI/c4ai-command-r-plus-4bit
Text Generation
•
Updated
Aug 13
•
883
•
237
javiagu/KULLM3_GPTQ
Text Generation
•
Updated
May 3
•
39
•
1
r4victor/gemma-7b-sft-qlora-no-robots
Updated
Apr 10
•
1
mistral-community/Mixtral-8x22B-v0.1-AWQ
Text Generation
•
Updated
Jul 5
•
31.8k
•
34
MaziyarPanahi/WizardLM-2-8x22B-GGUF
Text Generation
•
Updated
Apr 16
•
1.49k
•
114
unsloth/llama-3-8b-bnb-4bit
Text Generation
•
Updated
16 days ago
•
171k
•
176
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation
•
Updated
16 days ago
•
775k
•
123
mgoin/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
Apr 18
•
29
•
2
unsloth/llama-3-70b-bnb-4bit
Text Generation
•
Updated
16 days ago
•
2.86k
•
45
TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
Apr 19
•
737
•
16
SweatyCrayfish/llama-3-8b-quantized
Text Generation
•
Updated
Apr 20
•
45.8k
•
9
lucyknada/chargoddard_llama3-42b-v0-4.0bpw-EXL2
Text Generation
•
Updated
Apr 22
•
11
•
4
RichardErkhov/EleutherAI_-_polyglot-ko-5.8b-4bits
Text Generation
•
Updated
Apr 23
•
10
•
1
leliuga/Phi-3-mini-4k-instruct-bnb-4bit
Text Generation
•
Updated
Jun 8
•
114
•
3
ruslanmv/llama3-8B-medical
Text Generation
•
Updated
May 15
•
177
•
9
islam23/llama3-8b-RAG_News_Finance
Text Generation
•
Updated
May 14
•
19
•
1
zementalist/llama-3-8B-chat-psychotherapist
Text Generation
•
Updated
Apr 29
•
242
•
22
unsloth/Phi-3-mini-4k-instruct-bnb-4bit
Text Generation
•
Updated
16 days ago
•
34.6k
•
24
Previous
1
2
3
4
5
...
490
Next