File size: 750 Bytes
d7d0f08
1542eb7
daa1882
d7d0f08
 
 
 
 
6a09549
d7d0f08
 
 
 
 
 
 
1542eb7
d7d0f08
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---
title: tiny-santacoder
emoji: 🎅⚡️
sdk: docker
app_port: 8000
duplicated_from: matthoffner/ggml-ctransformers-fastapi
---

# santacoder-ggml

## <a href="https://github.com/ggerganov/ggml" target="_blank">ggml</a>
## <a href="https://github.com/marella/ctransformers" target="_blank">ctransformers</a>
## [FastAPI Docs](https://matthoffner-ggml-ctransformers-fastapi.hf.space/docs)

### Updates

* While WizardCoder proves to be capable on a CPU upgrade, there will be a need for santacoder-ggml as we look for best in class small model for edge
* Added /v1/chat/completions
* [Start using ctransformers](https://github.com/marella/ctransformers)
* [Added starcoder example](https://github.com/ggerganov/ggml/tree/master/examples/starcoder)