This tokenizer was created from the BrWac dataset (full version). It is been used by models originated from Flan-T5.

Inference Examples

Inference API (serverless) has been turned off for this model.

thegoodfellas
/

tgf-sp-unigram-tokenizer-ptbr

Dataset used to train thegoodfellas/tgf-sp-unigram-tokenizer-ptbr