chatLM format ?

#2
by Lingrui - opened

The messages in your code tells me that the roles are only user and assistant which need to be used generation_config.user_token_id and generation_config.assistant_token_id. But your generation_config.json has no user_token_id and assistant_token_id.
Additionally, the character in your reasoning example code is human.

Alpachino org

Sorry for our negligence. We have updated the code in the model card and provided a demo based on the implementation of Gradio.

Russal changed discussion status to closed

Sign up or log in to comment