README.md

JCrawler

Simple multi-threaded web crawler in Java.

Running instructions

1. Create config.txt in JCrawler.jar directory - See Example Configuration folder to view format

2. Run in CLI java -jar JCrawler.jar

3. Determine number of worker threads 2-10 should be perfectly fine