flash_attn
torch 
transformers
accelerate
bitsandbytes
gradio