fastapi
uvicorn
gradio
requests
git+https://github.com/path/to/llama-cpp.git