Hugging Face's logo

sonoisa
/
t5-base-japanese

Text2Text Generation
Transformers
PyTorch
JAX
Safetensors
Japanese
t5
feature-extraction
seq2seq
text-generation-inference
Inference Endpoints
Model card Files Community
2

Japanese Corpus Queries

#1
by ShortText - opened
Discussion
ShortText

The Japanese corpus which T5 or MT5 is using, is it based on Kanji texts or everything mixed (Kanji, Katakana, hirangana) ?

sonoisa
 Owner
•
edited Jun 28, 2022

I used mixed data.
The data used were the Japanese dump data from Wikipedia, the Japanese corpus from OSCAR, and the Japanese corpus from CC-100.

sonoisa changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment