This repositories contains a list of python scripts projects from beginner level advancing slowly. More code snippets to be added soon. feel free to clone this repo
An R web crawler and scraper
Simple and powerfull all in one Telegram Bot to scrap / crawl webpages using Requests, html5lib and Beautifulsoup
GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.
Automatically scrape the web data of people profiles on Linkedin based on a specific search query
DataScience365
Find host header injections and perform Host Header attacks with other kind of bugs like web cache poisoning
subfalcon is a subdomain enumeration tool that allows you to discover and monitor subdomains for a given list of domains or a single domain. It fetches subdomains from various sources, checks for potential subdomain takeover vulnerabilities, saves findings to a SQLite database, and can notify updates via Discord.
One-afternoon side project to play around with 🤗 Transformers & Streamlit
Evaluate JavaScript on a URL through headless Chrome browser.
TS-email-scraper is a data extraction software that is designed to scrape email addresses from websites. It is coded in JavaScript using the Crawlee library and runs on the Node.js platform. The software can scrape email addresses by using either google search keywords or individual domain URLs.
I have scraped International Statistical Classification of Diseases and Related Health Problems 10th Revision websites's data. It has all the diseases and health problems. I have also attached csv of scraped data which contains two column "Ids" and "Description".
Train Time Delay Prediction using machine learning
Multipurpose utility tool expressed using a custom JVM UI library built over Swing
Yet simple API wrapper for GoGoAnime
Web scraper for UniProt and iPTMnet database
COVID-19 is a disease caused by a new strain of coronavirus. 'CO' stands for corona, 'VI' for virus, and 'D' for disease. Formerly, this disease was referred to as '2019 novel coronavirus' or '2019-nCoV'. In Indonesia, for making data analysis, we should collected the daily data, which is limited. So, this program will update the data automatica…
Creation of a database for Digimon Card Game
Check the availabilty of O'Reillys free ebooks, create html page for better overview and downloadability.
Add a description, image, and links to the webscrapping topic page so that developers can more easily learn about it.
To associate your repository with the webscrapping topic, visit your repo's landing page and select "manage topics."