---
title: tiny-santacoder
emoji: 🎅⚡️
sdk: docker
app_port: 8000
duplicated_from: matthoffner/ggml-ctransformers-fastapi
---

# santacoder-ggml

## <a href="https://github.com/ggerganov/ggml" target="_blank">ggml</a>
## <a href="https://github.com/marella/ctransformers" target="_blank">ctransformers</a>
## [FastAPI Docs](https://matthoffner-ggml-ctransformers-fastapi.hf.space/docs)

### Updates

* While WizardCoder proves to be capable on a CPU upgrade, there will be a need for santacoder-ggml as we look for best in class small model for edge
* Added /v1/chat/completions
* [Start using ctransformers](https://github.com/marella/ctransformers)
* [Added starcoder example](https://github.com/ggerganov/ggml/tree/master/examples/starcoder)