Spaces:

huggingchat
/

chat-ui

Running

google/gemma-3-27b-it running into token limit

#719

by auerovkh - opened May 6

May 6

When using google/gemma-3-27b-it, I've noticed I run into the error

Input validation error: inputs tokens + max_new_tokens must be <= 4096. Given: 4182 inputs tokens and 0 max_new_tokens

After 3-4 messages. Should/can this be increased?

1 day ago

Ive noticed this too. Is there no way to trim older data as the conversation grows to make room? None of the other models have this issue.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment