torch torchvision transformers Pillow gradio # Install flash_attn directly from the GitHub repository git+https://github.com/HazyResearch/flash-attention.git