Marxav
/

frpron

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

frpron / special_tokens_map.json

Marxav's picture

add tokenizer

56a7094 almost 3 years ago

history blame contribute delete

84 Bytes

{"bos_token": ">", "eos_token": "<", "unk_token": "<|endoftext|>", "pad_token": "#"}