Tural
/

language-modeling-from-scratch

Model card Files Files and versions Community

language-modeling-from-scratch / added_tokens.json

Tural's picture

Upload tokenizer

8dc8639 over 1 year ago

history blame contribute delete

88 Bytes

	{
	"[CLS]": 2,
	"[FRN]": 5,
	"[MASK]": 4,
	"[PAD]": 1,
	"[SEP]": 3,
	"[UNK]": 0
	}