README.md

dockerized-django-selenium-cralwer

Configure sites to be crawled via simple django app (proxied with nginx, backed by postgres) and run tasks via celery that will parse websites with selenium/phantomjs. All parts in their own docker containers.