Spaces:
Runtime error
Runtime error
Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ sdk: docker
|
|
7 |
pinned: false
|
8 |
license: mit
|
9 |
app_port: 7860
|
10 |
-
short_description:
|
11 |
---
|
12 |
|
13 |
# Ghudsavar 🏇🏻
|
@@ -16,7 +16,9 @@ Github [iAkashPaul/Ghudsavar](https://github.com/iakashpaul/Ghudsavar)
|
|
16 |
|
17 |
> Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes, made available as a docker image. One click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).
|
18 |
|
19 |
-
Try it here [Ghudsavar](https://iakashpaul-ghudsavar.hf.space) default HF Space Embed messes up the themeing.
|
|
|
|
|
20 |
|
21 |
## Customize yours
|
22 |
|
|
|
7 |
pinned: false
|
8 |
license: mit
|
9 |
app_port: 7860
|
10 |
+
short_description: Phi-3-Mini on llama.cpp's server example
|
11 |
---
|
12 |
|
13 |
# Ghudsavar 🏇🏻
|
|
|
16 |
|
17 |
> Ghudsavar (Horse rider) - Is a quick llama.cpp server for CPU only runtimes, made available as a docker image. One click deployment to HuggingFace spaces (even on the free tier with 2 CPU-cores).
|
18 |
|
19 |
+
Try it here [Ghudsavar](https://iakashpaul-ghudsavar.hf.space) (default HF Space Embed messes up the themeing).
|
20 |
+
|
21 |
+
```Phi3-mini``` @Q4 runs at ~5tok/s
|
22 |
|
23 |
## Customize yours
|
24 |
|