Runbooks:Fastpath

Fastpath runbook

Manual deployment

ssh fastpath.ooni.nu
sudo apt-get update
apt-cache show fastpath | grep Ver | head -n5
sudo apt-get install fastpath

Restart

sudo systemctl restart fastpath

Rerun fastpath manually

ssh fastpath.ooni.nu
sudo sudo -u fastpath /bin/bash
cd
fastpath --help
# rerun without overwriting files on disk nor writing to database:
fastpath --start-day 2016-05-13 --end-day 2016-05-14 --stdout --nossh --no-write-msmt --no-write-to-db
# rerun without overwriting files on disk:
fastpath --start-day 2016-05-13 --end-day 2016-05-14 --stdout --nossh --no-write-msmt 
# rerun and overwrite:
fastpath --start-day 2016-05-13 --end-day 2016-05-14 --stdout --update --nossh

The fastpath will pull cans from S3. The daemon (doing real-time processing) can keep running in the meantime.

Progress chart

Log monitoring

sudo journalctl -f -u fastpath

Monitoring dashboard

https://mon.ooni.nu/grafana/d/0NwR3eUWz/fastpath?orgId=1&from=now-7d&to=now

Investigate missing msmts

SELECT report_id, input, test_start_time, probe_cc, probe_asn 
FROM measurement 
LEFT OUTER JOIN input ON input.input_no = measurement.input_no     
JOIN report ON report.report_no = measurement.report_no 
WHERE 
    NOT EXISTS ( 
        SELECT                                                    
        FROM                                           
            fastpath fp                                  
        WHERE                                            
            measurement_start_time > NOW() - interval '48 hours' 
            AND measurement_start_time <= NOW() 
            AND fp.report_id = report.report_id                      
            AND fp.test_name = report.test_name 
            AND fp.input = input.input) 
    AND measurement_start_time > NOW() - interval '48 hours' 
    AND measurement_start_time <= NOW() 
LIMIT 100;