Spaces:
Paused
Paused
| title: tiny-santacoder | |
| emoji: 🎅⚡️ | |
| sdk: docker | |
| app_port: 8000 | |
| duplicated_from: matthoffner/ggml-ctransformers-fastapi | |
| # santacoder-ggml | |
| ## <a href="https://github.com/ggerganov/ggml" target="_blank">ggml</a> | |
| ## <a href="https://github.com/marella/ctransformers" target="_blank">ctransformers</a> | |
| ## [FastAPI Docs](https://matthoffner-ggml-ctransformers-fastapi.hf.space/docs) | |
| ### Updates | |
| * While WizardCoder proves to be capable on a CPU upgrade, there will be a need for santacoder-ggml as we look for best in class small model for edge | |
| * Added /v1/chat/completions | |
| * [Start using ctransformers](https://github.com/marella/ctransformers) | |
| * [Added starcoder example](https://github.com/ggerganov/ggml/tree/master/examples/starcoder) |