webscarper / output.txt
mobenta's picture
Upload folder using huggingface_hub
5e62ae2 verified
ScrapeMaster 3.0Search this siteSkip to main contentSkip to navigationHomeDownloadsScrapeMasterScrapeMaster 2.0ScrapeMaster 3.0AutomationRegistration FormBlogsClipboard AIContact HomeDownloadsScrapeMasterScrapeMaster 2.0ScrapeMaster 3.0AutomationRegistration FormBlogsClipboard AIContactMoreHomeDownloadsScrapeMasterScrapeMaster 2.0ScrapeMaster 3.0AutomationRegistration FormBlogsClipboard AIContactScrapeMaster 3.01. Create a new folder and Install & activate your virtual environnement  2. Create a file requirements.txt and copy the following libraries 3. pip install requirements 4. Create .env file and add your api keys 5. Downlaod ChromeDriver from (Chrome for Testing availability (googlechromelabs.github.io) )6. Create assets.py file (it will include all model names and settings) 7. Create scraper.py file (this is the file responsible for scraping and parsing) 8. Create pagination_detector.py 9. Create streamlit_app.py 10. Run streamlit_app.py Google SitesReport abusePage detailsPage updated Google SitesReport abuse