kykim
/

gpt3-kor-small_based_on_gpt2

gpt3-kor-small_based_on_gpt2 / tokenizer_config.json

Update tokenizer_config.json

cfe4828 almost 2 years ago

120 Bytes

	{
	"do_lower_case": true,
	"strip_accents": false,
	"model_max_length": 2048,
	"tokenizer_class": "BertTokenizer"
	}