Skip to content

Latest commit

 

History

History
3 lines (3 loc) · 329 Bytes

readme.md

File metadata and controls

3 lines (3 loc) · 329 Bytes

Link Crawler in Python

A simple crawler that uses the Breadth First Search algorithm to crawl a given website and its sup-pages. It reports any links that lead to websites that are not available (i.e. 'broken links'). I wrote a similar crawler around 4 years ago using PHP. I added it to the repository for comparison.