offenesparlament.de

This projects contains the API for offenesparlament.de. The Scrapers for offenesparlament.de can be found here:

• PLPR Scraper for the protocols of the Bundestag
• Topscraper for all the TOPs with speaker lists
• Agenda Scraper for all TOPs with meta information

Setup

To Setup the Database the following steps need to be performed:

1. setup the database from Pretty Session Protocols the get the right schema

2. clone PLPR scraper repository and scrape the session protocols via the PLPR Scraper with

DATABSE_URI=<db_url> python views.py
#e.g.: DATABSE_URL=sqlite:////home/user/db.sqlite python scraper/scraper.py

3. scrape TOPs with Topscraper and AgendaScraper
4. merge scraped Tops into the Database with the Topmerger
5. merge MDBs for MdB Merger
6. start the server with

DATABSE_URI=<db_url> python views.py
#e.g.: DATABSE_URL=sqlite:////home/user/db.sqlite python3 plenartracker.py