SquanchNastyAI / tokenizer_config.json
or4cl3ai's picture
Create tokenizer_config.json
d717b6c
raw
history blame
101 Bytes
{
"model_type": "SquanchNasty AI Model",
"tokenizer_type": "gpt-3.5-turbo",
"max_length": 512
}