Provide a local AI using deepseek model

README.md

@@ -11,4 +11,4 @@ license: apache-2.0
 short_description: Testing for e-commerce
 ---
 
-An example chatbot using [Gradio](https://gradio.app), [`huggingface_hub`](https://huggingface.co/docs/huggingface_hub/v0.22.2/en/index), and the [Hugging Face Inference API](https://huggingface.co/docs/api-inference/index).
+An example chatbot using [Gradio](https://gradio.app), [`huggingface_hub`](https://huggingface.co/docs/huggingface_hub/v0.25.2/en/index), and the [Hugging Face Inference API](https://huggingface.co/docs/api-inference/index).

app.py

@@ -1,10 +1,20 @@
 import gradio as gr
 from huggingface_hub import InferenceClient
+from huggingface_hub.utils import HfHubHTTPError
+import os
+from dotenv import load_dotenv
+
+# Load environment variables from .env file
+load_dotenv()
 
 """
 For more information on `huggingface_hub` Inference API support, please check the docs: https://huggingface.co/docs/huggingface_hub/v0.22.2/en/guides/inference
 """
-client = InferenceClient("HuggingFaceH4/zephyr-7b-beta")
+api_token = os.getenv("HUGGINGFACE_API_TOKEN")
+if not api_token:
+    raise ValueError("HUGGINGFACE_API_TOKEN environment variable not set")
+
+client = InferenceClient("HuggingFaceH4/zephyr-7b-beta", token=api_token)
 
 
 def respond(

requirements.txt

@@ -1 +1,3 @@
-huggingface_hub==0.25.2
+huggingface_hub==0.25.2
+requests==2.31.0
+python-dotenv==1.0.0