mobiuslabsgmbh/Llama-2-7b-hf-4bit_g64-HQQ
Text Generation
•
Updated
•
21
•
2
Llama2 HQQ Quantized Models
LLama2 models quantized using https://github.com/mobiusml/hqq
-
-
mobiuslabsgmbh/Llama-2-13b-hf-4bit_g64-HQQ
Text Generation • Updated • 12 • 1 -
mobiuslabsgmbh/Llama-2-70b-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 12 • 2 -
mobiuslabsgmbh/Llama-2-70b-chat-hf-2bit_g16_s128-HQQ
Text Generation • Updated • 14 • 3 -
mobiuslabsgmbh/Llama-2-7b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 17 • 3 -
mobiuslabsgmbh/Llama-2-13b-chat-hf-4bit_g64-HQQ
Text Generation • Updated • 9 • 1