What does "use as API" mean in README?

#1
by tastypear - opened

I see the phrase "Recommend to use as API" in the README file. Are you referring to the Gradio API?

BTW, I tried to create an OpenAI-compatible interface using client = InferenceClient("google/gemma-3-27b-it") and fastapi, but it didn't work. The requests were automatically routed to the HuggingFace Serverless Interface and failed to respond. Very strange.

Yes, I mean a Gradio API.
The code should not work with other APIs.

bafifi4972 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment