takumi12
/

id2pg_pattern1_ja_b4e20_test

Model card Files Files and versions Community

id2pg_pattern1_ja_b4e20_test / added_tokens.json

takumi12's picture

Upload tokenizer

67ac915 almost 2 years ago

history blame contribute delete

126 Bytes

	{
	"</s>": 2,
	"<s>": 1,
	"<unk>": 0,
	"▁<EOT>": 32010,
	"▁<MID>": 32009,
	"▁<PRE>": 32007,
	"▁<SUF>": 32008
	}