GitHub - RamseyvanderMeer/scrapy: Scraping bot pulling schedule from https://www.internationalrafting.com/racing/events/

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
waterScrape		waterScrape
.env.example		.env.example
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
docker-compose.yml		docker-compose.yml

Repository files navigation

scrapy

set up

cd into working folder

run command to output data into .json file

scrapy crawl event

Todo:

Secondary parse to get full description
[√] Date parsing to ISO-8601
Allow auth to .env variables for DB pipeline
Finalize incremental update logic
tests

About

Scraping bot pulling schedule from https://www.internationalrafting.com/racing/events/

beautifulsoup scra

Report repository

Releases

No releases published

Packages

No packages published

Languages