takumi12
/

id2pg_pattern2_ja_e100_78_test

Model card Files Files and versions Community

id2pg_pattern2_ja_e100_78_test / added_tokens.json

takumi12's picture

Upload tokenizer

d6a2d49 12 months ago

history blame contribute delete

No virus

126 Bytes

	{
	"</s>": 2,
	"<s>": 1,
	"<unk>": 0,
	"▁<EOT>": 32010,
	"▁<MID>": 32009,
	"▁<PRE>": 32007,
	"▁<SUF>": 32008
	}