Max input tokens

#3
by yunsxie - opened

Hello, thank you for the great work. I'm wondering what is the maximum input token number does this model support? Evidentially, according to https://huggingface.co/01-ai/Yi-34B the baseline model is able to support 32K token input. Have you happened to test it?

Southern university of science and technology org

The base model only support 4K token input

facat changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment