Gemma 3 27B cuts off response halfway when performing a web search

#709
by Chroma111 - opened

When I ask Gemma 3 to perform a web search with the search tool enabled when researching something, it cuts off the response halfway. I have to tell it to continue to split the message into two separate ones. I also got this error message when I asked the AI to continue:

Input validation error: inputs tokens + max_new_tokens must be <= 4096. Given: 6724 inputs tokens and 0 max_new_tokens

Chroma111 changed discussion title from Gemma 3 27B cuts off response halfway when performing a web search. to Gemma 3 27B cuts off response halfway when performing a web search
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment