README.md

metadata

title: ggml-ctransformers-fastapi
emoji: 🐳🤗⚡️
sdk: docker
app_port: 8000
duplicated_from: matthoffner/ggml-ctransformers-fastapi

ggml-ctransformers-fastapi

ggml

ctransformers

FastAPI Docs

Updates

• Added /v1/chat/completions
• Start using ctransformers
• Added starcoder example