server.cpp / README.md
iAkashPaul's picture
Update README.md
e5cd6b7 verified
|
raw
history blame
578 Bytes
metadata
title: Ghudsavar
emoji: πŸ‡πŸ»
colorFrom: gray
colorTo: green
sdk: docker
pinned: false
license: mit
app_port: 7860

Ghudsavar πŸ‡πŸ»

Github iAkashPaul/Ghudsavar

Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes, made available as a docker image. One click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).

Customize yours

git clone https://github.com/iakashpaul/Ghudsavar.git
docker build -t iakashpaul/Ghudsavar:latest . --platform linux/amd64