ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

SpiridonSunRotator commited on Apr 29

Commit

e16ede7

•

1 Parent(s): 4c0d06b

Metric fix

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,5 +16,5 @@ For this quantization, we used 1 codebook of 16 bits.
 Results (in progress):
 | Model      | Quantization | MMLU (5-shot) | ArcC| ArcE| Hellaswag | Winogrande | PiQA | Model size, Gb |
 |------|------|-------|------|------|------|------|------|------|
-|meta-llama/Meta-Llama-3-70B | - | 0.6596 | 0.8935 | 0.6921	| 0.8444 | 0.8090 | 141.2 |
 |  | 1x16 | 0.7475| 0.6049 | 0.8468 | 0.6520 | 0.8248 | 0.7790 | 21.9 |

 Results (in progress):
 | Model      | Quantization | MMLU (5-shot) | ArcC| ArcE| Hellaswag | Winogrande | PiQA | Model size, Gb |
 |------|------|-------|------|------|------|------|------|------|
+|meta-llama/Meta-Llama-3-70B | - | - | 0.6596 | 0.8935 | 0.6921	| 0.8444 | 0.8090 | 141.2 |
 |  | 1x16 | 0.7475| 0.6049 | 0.8468 | 0.6520 | 0.8248 | 0.7790 | 21.9 |