Add EOS token

#100

by joaogante HF staff - opened Jan 27, 2024

base: refs/heads/main

←

from: refs/pr/100

Discussion Files changed

-2

joaogante

Jan 27, 2024

This PR adds the EOS token to the model configuration, as per the EOS token set in the tokenizer configuration. Some advanced generation modes in .generate() require the EOS token to be set :)

Add EOS tokenec7094f5

gugarosa changed pull request status to merged Jan 27, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment