gradio
transformers
torch
accelerate
flash-attn