question about tokenizer

#7
by surya-narayanan - opened

Hi,

do the tiny, small, medium and mini models all use the same tokenizer?

prajjwal1 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment