cyrilzhang
/

ts-bpe-2k

Model card Files Files and versions Community

ts-bpe-2k / special_tokens_map.json

cyrilzhang's picture

Upload tokenizer

6eb5bf7 over 1 year ago

history blame contribute delete

55 Bytes

	{
	"eos_token": "<\|eos\|>",
	"pad_token": "<\|pad\|>"
	}