ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-70B-AQLM-2Bit-1x16

1 contributor

History: 9 commits

SpiridonSunRotator's picture

SpiridonSunRotator

Updated metrics

ddb56ce verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

711 Bytes

Updated metrics 7 months ago
config.json

9.38 kB

Uploaded improved version of quantized model 7 months ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 7 months ago
model-00001-of-00005.safetensors

5 GB
LFS

Uploaded improved version of quantized model 7 months ago
model-00002-of-00005.safetensors

4.96 GB
LFS

Uploaded improved version of quantized model 7 months ago
model-00003-of-00005.safetensors

4.99 GB
LFS

Uploaded improved version of quantized model 7 months ago
model-00004-of-00005.safetensors

4.87 GB
LFS

Uploaded improved version of quantized model 7 months ago
model-00005-of-00005.safetensors

2.1 GB
LFS

Uploaded improved version of quantized model 7 months ago
model.safetensors.index.json

152 kB

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization 7 months ago
special_tokens_map.json

73 Bytes

Uploaded tokenizer 7 months ago
tokenizer.json

9.08 MB

Uploaded tokenizer 7 months ago
tokenizer_config.json

50.6 kB

Uploaded tokenizer 7 months ago