abhirajeshbhai
/

gpt2_dad_joke_tokenizer

Model card Files Files and versions Community

gpt2_dad_joke_tokenizer / added_tokens.json

abhirajeshbhai's picture

Upload tokenizer

ddb4ece 12 months ago

No virus

101 Bytes

	{
	"<bos>": 50258,
	"<eos>": 50259,
	"<pad>": 50257,
	"<\|endoftext\|>": 50256,
	"JOKE:": 50260
	}