Collection of quantized versions of Meta-Llama-3-8B-Instruct model
-
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-8bit
Text Generation • Updated • 23 • 1 -
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-4bit
Text Generation • Updated • 15 • 1 -
alokabhishek/Meta-Llama-3-8B-Instruct-5.0-bpw-exl2
Text Generation • Updated • 8 • 1 -
alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2
Text Generation • Updated • 6 • 1