ISTA-DASLab
/

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

2 contributors

History: 2 commits

SpiridonSunRotator's picture

SpiridonSunRotator

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization

712c4fa verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
config.json

9.38 kB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
model-00001-of-00005.safetensors

5 GB
LFS

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
model-00002-of-00005.safetensors

4.96 GB
LFS

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
model-00003-of-00005.safetensors

4.99 GB
LFS

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
model-00004-of-00005.safetensors

4.87 GB
LFS

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
model-00005-of-00005.safetensors

2.1 GB
LFS

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
model.safetensors.index.json

152 kB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
special_tokens_map.json

73 Bytes

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
tokenizer.json

9.08 MB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago
tokenizer_config.json

50.6 kB

Uploaded Meta-Llama-Instruct-3-70B with AQLM 1x16 quantization 7 months ago