Spaces:
Running
on
Zero
Running
on
Zero
Can I use this as an inference endpoint
#8
by
PegasusPedal
- opened
hello Developers,
I was just curious that can I use the API of this as an inference endpoint for my application?
I wish to create an app using GEMMA as LLM Provider for my GSOC application.
Here is the PS:
here is the link:https://gist.github.com/dynamicwebpaige/92f7739ad69d2863ac7e2032fe52fbad#11-gemma-model-projects-
I tried to run the model, but due to its large size and the limited resources i have , inferencing takes a lot of time.
Waiting eagerly for a positive response.
Thank you!