huggingface_hub==0.25.2
gradio
transformers
torch
gguf>=0.10.0