requirements.txt

huggingface_hub==0.25.2
gradio
transformers>=4.45.1
torch
gguf>=0.10.0
sentencepiece
numpy==1.21.0
bitsandbytes
accelerate>=0.26.0
https://github.com/bitsandbytes-foundation/bitsandbytes/releases/download/continuous-release_multi-backend-refactor/bitsandbytes-0.44.1.dev0-py3-none-manylinux_2_24_x86_64.whl