YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Gradio app to run QA on a given website

What does the app do :

  • Get input prompt (text or transcribed audio)
  • Similarity search in a vector DB, returns top k chunks
  • Run llm based on context (using basic prompt - langchain not used yet)
  • Return response and metadata (url, scores, text chunks...)

Setup process:

  • vector store (FAISS) a given website (sitemap) using langchain
  • download a llm
  • containarise stt (faster-whisper) due to os incompatibility
  • build Gradio app

To build Faster-whisper docker image name "fasterwhisper"

docker build -t . fasterwhisper

Create python env 'llama'

conda create --name="llama" python=3.10
conda activate llama
pip install -r requirements.txt

To run the app:

bash run.sh

To push to hugging face (including large files) use this command:

git lfs migrate import --everything

git add .; git commit -m "message"; git push -f origin

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.