Spaces:
Runtime error
Runtime error
File size: 786 Bytes
ee4bf46 d133a8e ee4bf46 d87cb51 b2a0119 ee4bf46 e5cd6b7 d133a8e b2a0119 1f1fa58 d133a8e 849f584 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 |
---
title: Ghudsavar
emoji: 🏇🏻
colorFrom: gray
colorTo: green
sdk: docker
pinned: false
license: mit
app_port: 7860
short_description: Phi-3-Mini on llama.cpp's server example
---
# Ghudsavar 🏇🏻
Github [iAkashPaul/Ghudsavar](https://github.com/iakashpaul/Ghudsavar)
> Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes, made available as a docker image. One click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).
Try it here [Ghudsavar](https://iakashpaul-ghudsavar.hf.space) (default HF Space Embed messes up the themeing).
```Phi3-mini``` @Q4 runs at ~5tok/s
## Customize yours
```bash
git clone https://github.com/iakashpaul/Ghudsavar.git
docker build -t iakashpaul/Ghudsavar:latest . --platform linux/amd64
``` |