AI_Powered_Web_Scraper / requirements.txt
MagicMeWizard's picture
Update requirements.txt
d420c16 verified
# AI Dataset Studio - Complete Dependencies
# Core framework
gradio>=4.44.0
# Data processing
pandas>=2.0.0
numpy>=1.24.0
# Web scraping
requests>=2.31.0
beautifulsoup4>=4.12.0
# AI/ML models (optional but recommended)
transformers>=4.30.0
torch>=2.0.0
nltk>=3.8.0
# HuggingFace ecosystem
datasets>=2.14.0
# Text processing
textstat>=0.7.0
# Perplexity AI integration
# requests is already included above for API calls
# Development and utilities
python-dateutil>=2.8.0