Text Generation
Transformers
PyTorch
gpt2
text-generation-inference
Inference Endpoints
4-bit precision
gptq
gpt-sw3-6.7b-v2-instruct-4bit-gptq / generation_config.json
nicher92's picture
Upload model
08a7310
raw
history blame
154 Bytes
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 1,
"max_length": 2048,
"pad_token_id": 0,
"transformers_version": "4.34.1"
}