Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

139

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

prithivMLmods/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 4 days ago • 339 • 8

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 114k • 75

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 5.32k • 17

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25 • 20.5k • 16

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Sep 30 • 266k • 14

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 1.87M • 8

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8 • 233 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 38.6k • 40

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 8.12k • 28

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25 • 11 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25 • 901 • 2

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8 • 100 • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25 • 804 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9 • 1.92k • 2

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 1.02k • 1

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 1.34k • 1

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 313 • 1

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16 • 13.1k • 2

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 11 • 1

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26 • 6 • 1

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 24 • 1

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 132 • 1

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1 • 287 • 3

QuantFactory/Llama-3.2-Taiwan-Legal-3B-Instruct-GGUF

Text Generation • Updated 17 days ago • 2.28k • 8

QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF

Text Generation • Updated Oct 8 • 696 • 3

QuantFactory/Llama3.2-3B-Enigma-GGUF

Text Generation • Updated Oct 8 • 715 • 2

QuantFactory/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • Updated Oct 8 • 701 • 3

QuantFactory/Llama3.2-3B-Esper2-GGUF

Text Generation • Updated Oct 8 • 652 • 3

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 8 • 2.36k • 6

Esperanto/llama-3.2-3B-Instruct-kvc-fp16-onnx

Text Generation • Updated Oct 9 • 12 • 1