fastapi
uvicorn[standard]
transformers
torch 
torchaudio 
torchvision
pydantic
sentencepiece
accelerate>=0.26.0