lst-nectec
/

HoogBERTa

Inference Endpoints

Model card Files Files and versions Community

HoogBERTa / tokenizer_config.json

new5558's picture

Upload tokenizer

d9a424a over 1 year ago

195 Bytes

	{
	"bos_token": "<s>",
	"cls_token": "<s>",
	"eos_token": "</s>",
	"mask_token": "<mask>",
	"model_max_length": 512,
	"pad_token": "<pad>",
	"tokenizer_class": "PreTrainedTokenizerFast"
	}