size of vocab_size and tokenizer model off by 1

#3
by daboe01 - opened

tokenizer.vocab_size(): 32000
model.embed_tokens.weight: 32001

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment