Native bitsandbytes 4bit pre quantized models
Unsloth AI
Enterprise
company
AI & ML interests
Hey! We're focusing on making AI more accessible to everyone!
Organization Card
🦥Unsloth makes fine-tuning of LLMs 2.2x faster and use 80% less VRAM!
Join our Discord server! Our open source Github: https://github.com/unslothai/unsloth
Unsloth support includes | Free Notebooks | Performance | Memory use |
---|---|---|---|
Llama 3.1 (8B) | ▶️ Start on Colab | 2.1x faster | 60% less |
Gemma 2 (9B) | ▶️ Start on Colab | 2x faster | 63% less |
Mistral Nemo (12B) | ▶️ Start on Colab | 2x faster | 60% less |
Phi-3.5 (mini) | ▶️ Start on Colab | 2x faster | 50% less |
Collections
2
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • Updated • 297k • 35 -
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
Text Generation • Updated • 13.7k • 16 -
unsloth/gemma-2-9b-it-bnb-4bit
Text Generation • Updated • 29k • 17 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • Updated • 775k • 123
models
173
unsloth/Qwen2.5-32B-Instruct-bnb-4bit
Text Generation
•
Updated
•
2
unsloth/Qwen2.5-1.5B-bnb-4bit
Text Generation
•
Updated
unsloth/Qwen2.5-72B-Instruct-bnb-4bit
Text Generation
•
Updated
unsloth/Qwen2.5-3B-bnb-4bit
Text Generation
•
Updated
unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit
Text Generation
•
Updated
•
1
unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit
Text Generation
•
Updated
unsloth/Qwen2.5-72B-bnb-4bit
Text Generation
•
Updated
unsloth/Qwen2.5-3B-Instruct-bnb-4bit
Text Generation
•
Updated
•
1
unsloth/Qwen2.5-7B-bnb-4bit
Text Generation
•
Updated
unsloth/Qwen2.5-7B-Instruct-bnb-4bit
Text Generation
•
Updated
•
1