lebe1
/

opt-125m-8bit

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

1 contributor

History: 4 commits

lebe1's picture

AutoGPTQ model for facebook/opt-125m: 8 bits

0dc8b1a 12 months ago

.gitattributes

1.52 kB

initial commit 12 months ago
config.json

1.45 kB

AutoGPTQ model for facebook/opt-125m: 8 bits 12 months ago
generation_config.json

137 Bytes

AutoGPTQ model for facebook/opt-125m: 8 bits 12 months ago
gptq_model-8bit-128g.safetensors

245 MB
LFS

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False 12 months ago
model.safetensors

168 MB
LFS

AutoGPTQ model for facebook/opt-125m: 8bits 12 months ago
quantize_config.json

240 Bytes

AutoGPTQ model for facebook/opt-125m: 8bits, gr128, desc_act=False 12 months ago