Please Help Adding & Running this Model Locally on a 4GB RAM Android Tablet

#1
by 1Me - opened

I'm an AI Beginner, I've Watched Loads of *Tube Videos, the Learning Curve iz Steep & Challenging Comprehending this Tec', but I'm Determined & in spite of me 63 mature years, I'll Persevere since I've been Werking around Computers 4 the last 1/4 Century or so, including Servers Briefly about a Decade ago, Not Software development, but Mainly Hardware wYze, but including installing & Using MacOS, Several Linuxs & of course the inevitable M$ Virus Bait WinDoze! But Please don't assume that I'm a CLi Guru, because I'm Not!

So having now dispensed w/ the entre / preamble, can I Please Request Help / Get Guidance from a Kind Person, that can assist me on my Training Wheels while I get up 2 Speed, because altho I've eNdeavored 2 Find anyone / or Group Locally ( Here in Auckland, Godzone, NZ ), Not Yet But Maybe Next Week or Next Month or Next Year or Next Decade, etc...

I just want Help 2 Add & Run Slim GGUF LLMs from HuggingFace.co or GitHub ( because I've eXhausted the Ltd Choices @ Ollama.com & I'm choosing 2 give M$ phi & gOOgle Gemma Spyware a Wide Berth ) on my Humble 4Gb Samsung Galaxy Tab A9. Of course the Objective iz about Portability & I have Ltd resources. Please & Thanx in Advance ;-)K

Ps. I couldn't see the *B Parameters in the Title or on the Model card, so I'm Hoping that my Humble 4GB Device can Cope w/ this Model, maybe around about 2B ?!?

PPs in case I'm Barking Up the wRong Tree 4 All my Questions, Please point me in the Rite Direction...

;-)K

Sign up or log in to comment