Serverless configuration
#111
by
WaleedJubeh
- opened
Hi all,
I want to ask about the pro token. If I have used the pro token, can I send a larger query length?, or can I control this value?
My query length is longer than 1024, and I want to send the whole query in 1 request.
Hi there, I think there is a misunderstanding here, what do u mean by pro token? For the Hugging face API? cause you dont need to set an input size for your query only output.
@pandora-s
I meant the pro subscription.
https://huggingface.co/blog/inference-pro