Skip to content
Dan Bramich edited this page Apr 23, 2023 · 49 revisions

Welcome to the Wiki for the Loop Detector Reformatted Data 41 Cities Pipeline.

Requirements

To run this pipeline, you will need:

  • Python 3.7.3 (with packages: astropy 3.2.1, numpy 1.16.4)

  • The original data on the loop detector locations and their time-series measurements, and the associated roads. Please contact me for access.

Installation And Configuration

(i) Clone the repository into a destination directory <dir>/LDRD_41_Cities_Pipeline of your choice.

(ii) Edit the file <dir>/LDRD_41_Cities_Pipeline/config/bashrc by inserting the destination directory <dir> into the line:

export PYTHONPATH="<dir>:$PYTHONPATH"

(iii) Edit the file <dir>/LDRD_41_Cities_Pipeline/config/config.py to set the parameters as appropriate (e.g. the input and output directories).

(iv) Add the following line to your .bashrc file in your home directory:

source <dir>/LDRD_41_Cities_Pipeline/config/bashrc

(v) Source the .bashrc file in your home directory for the change to have effect:

source .bashrc

Running The Pipeline

To run each stage of the pipeline, from within the directory <dir>/LDRD_41_Cities_Pipeline, issue the following commands in order:

./s0_import_and_organise_data.py

Continue with either:

./s1a_filter_data.py

./s2a_convert_data_to_2D_format.py

or:

./s1b_filter_data.py

./s2b_manual_quality_check.py

./s3b_convert_data_to_2D_format.py

The a and b branches of the pipeline are the same except that the b branch includes an extra filter on the minimum acceptable number of good measurements for a single loop detector and a manual acceptance of each empirical fundamental diagram.

Note that a description of each stage is available in the corresponding script file.

Also, in the directory <dir>/LDRD_41_Cities_Pipeline/extract_osm_network, there is a set of instructions in the README file for downloading, extracting, and preparing the files describing the underlying network for each city.

Links