Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create ETL to check for missing crashes with missing CR3 pdfs #18954

Open
johnclary opened this issue Sep 9, 2024 · 0 comments
Open

Create ETL to check for missing crashes with missing CR3 pdfs #18954

johnclary opened this issue Sep 9, 2024 · 0 comments
Labels
Product: Vision Zero Crash Data System Centralize the management of ATD's Vision Zero data Service: Dev Infrastructure and engineering Workgroup: VZ Vision Zero Program

Comments

@johnclary
Copy link
Member

johnclary commented Sep 9, 2024

We should set up a daily check to make sure that all crashes have a CR3 PDF downloaded. We cannot enforce this check in our CRIS import ETL, because CRIS only includes PDFs for new crashes.

To check for crashes without a PDF, we must exclude pre-2014 crashes and temp records. E.g.

select id, cris_crash_id, crash_timestamp from crashes
  where cr3_stored_fl is false and is_temp_record = false and crash_timestamp > '2014-01-02';

See also these related PRs:

@johnclary johnclary added Service: Dev Infrastructure and engineering Workgroup: VZ Vision Zero Program Product: Vision Zero Crash Data System Centralize the management of ATD's Vision Zero data labels Sep 9, 2024
@johnclary johnclary assigned johnclary and unassigned johnclary Sep 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Product: Vision Zero Crash Data System Centralize the management of ATD's Vision Zero data Service: Dev Infrastructure and engineering Workgroup: VZ Vision Zero Program
Projects
None yet
Development

No branches or pull requests

1 participant