Can I use this as an inference endpoint

#8
by PegasusPedal - opened

hello Developers,
I was just curious that can I use the API of this as an inference endpoint for my application?
I wish to create an app using GEMMA as LLM Provider for my GSOC application.
Here is the PS:
Screenshot 2025-03-24 004531.jpg

here is the link:https://gist.github.com/dynamicwebpaige/92f7739ad69d2863ac7e2032fe52fbad#11-gemma-model-projects-
I tried to run the model, but due to its large size and the limited resources i have , inferencing takes a lot of time.

Waiting eagerly for a positive response.
Thank you!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment