Quantized Llama 3.1 - a kaitchup Collection

kaitchup 's Collections

Tulu and OLMo 2 Quantized

Qwen2.5 Quantized

Opus Translation Datasets

GPTQ

Yi

Contaminated Mistral 7B and TinyLlama

Llama 3 70B ExLlamaV2 (bpw: 4.0, 3.5, 3.0, 2.5, and 2.18)

[Basics] Quantized Phi-3

[Basics] AutoRound: Llama 3

Quantized Llama 3.1

The Minitron Models and Their Teachers, Quantized

Minivoc

Quantized Llama 3.1

updated Aug 12

kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-sym

Text Generation • Updated Aug 13 • 16 • 1
kaitchup/Meta-Llama-3.1-8B-Instruct-awq-4bit

Text Generation • Updated Aug 13 • 29k
kaitchup/Meta-Llama-3.1-8B-awq-4bit

Text Generation • Updated Aug 6 • 9
kaitchup/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Aug 13 • 7
kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-asym

Text Generation • Updated Aug 13 • 7 • 1
kaitchup/Meta-Llama-3.1-8B-autoround-gptq-4bit-asym

Text Generation • Updated Aug 7 • 17
kaitchup/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Aug 6 • 11
kaitchup/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Aug 13 • 8
kaitchup/Meta-Llama-3.1-8B-autoround-gptq-4bit-sym

Text Generation • Updated Oct 10 • 11
kaitchup/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Aug 6 • 21