huggingface_hub==0.25.2
gradio
transformers
torch
gguf>=0.10.0
sentencepiece
numpy==1.21.0
bitsandbytes