SpiridonSunRotator's picture
Added initial model card
75d8ed3 verified
|
raw
history blame
484 Bytes
metadata
library_name: transformers
tags:
  - llama
  - facebook
  - meta
  - llama-3
  - conversational
  - text-generation-inference

Official AQLM quantization of meta-llama/Meta-Llama-3-70B .

For this quantization, we used 1 codebook of 16 bits.

Results (in progress):

Model Quantization Model size, Gb
meta-llama/Meta-Llama-3-70B - 141.2
1x16 21.9