Skip to content

Sprint 25

Jump to bottom
Drew Rotheram edited this page Sep 3, 2024 · 10 revisions

Sprint Notes

VRRC Dashboard

  • Implement S3 raster tiles s3 signed urls - Mandip/Drew
  • Observation Log UI - Mandip/Drew/Chloe - [x] Design session - Chloe/Drew
  • Test latest dash version - Mandip
  • Bilingual dashboard -
  • Add GC upper left logo - Mandip
  • Implement CI/CD -

VRRC API

  • Implementing a observation log table - Tim
    • Define observation data model
  • Interferogram table - Tim - [x] Add orbitdatasource (Downlinked vs Definitive vs unknown) - [x] Automatically generated pairs *5 pairs default
  • Implement coherence matrix route - Tim
  • Implement potential pairs route - Tim
  • Populate legacy processed interferograms

DUAP-InSAR-Processor

  • Process backlog of rastertiles (landmass sandbox) - Mandip - [ ] Add displacement map rastertiles - new colour table required - backlog
  • Convert config.ini to .env - Chloe
  • Github actions - [x] Action for Docker Container build - Drew - [x] Flake8 and Pylint - Drew - [ ] Fix Flake8 and PyLint Errors -
  • General code refactor - Chloe
  • Local InSAR processing test - Drew
  • Check for downlinked orbits and run RCM_orb_filt.py - Mandip - Backlog
  • CDK for running processor in Batch - Tim
  • Develop manual time-series workflow - Mandip/Drew

Docker-Geoserver

  • Deprecate the use of geoserver - Drew

VRRC-InSAR-Hub

  • Record SpecialHandlingFlag in SLC Table - Tim

  • Set OrbitDataSource in SLC table - Tim

  • Create Batch job in AWS to start processing - Tim - [x] Create New IFG record - [ ] Logic to run processing

  • Implement HyP3 processing/download for test site - Edgecumbe - Mandip - backlog

    • Try running on eodms-cli ec2 instance

SAR Data Sources

  • RCM MOU - Review backlog - Drew
  • Re-process all Reykjanes 5M4 data with definitive orbits - Mandip

System Architecture

  • Dedicated AWS (Staging) Environment - backlog - Tim/Drew

  • Automate CDK deployment

    • PosGreSQL

    • PostGIS - manually implemented on RDS

    • VRRC API

    • VRRC InSAR-Hub

    • S3 Buckets

    • VRRC-Dashboard

    • Batch process for Duap Insar Processor - Tim

  • Reviewing AWS ProServe proposal - blocked

  • Reviewing requirements for LZA -

  • Develop rough cost estimate for API and DB - Tim

    • Running $140 USD/month as of Jan 29, 2024
    • Running $106 USD/month as of Feb 26, 2024
    • Running $145 USD/month as of March 18, 2024
    • Running $154.67 USD/month as of April , 2024
    • Running $209.46 USD/month as of May , 2024
    • Running $248.00 USD/month as of June , 2024
    • Running $288.00 USD/month as of July , 2024
    • Running $354.17 USD/Month as of August, 2024

Documenting & Reporting

  • Milestone Report due end of Fiscal - Drew/Nick

Administrative

  • Reach out to Hugo Drouin re: EODMS VAP API - backlog
  • Start engagement with SSC Science Cloud Enablement
  • Request access to AWS LZA environment - Drew/Tim

Demos

Mandip - Observation Log Chloe - Tim - InSAR Hub - queueing new processing, Dashboard coherence table Drew - Reykjanes InSAR Time-series (downlinked vs definitive)

Scrum Notes:

August 8th, 2024 Mandip - Reviewing pre-signed s3 URLs - Working on Rastertile generation in batches - Creating a new site for Reykjanes - Reprocessing definitive pairs

Tim - Working on SLC handling on InSAR Hub - special handling - reviewing pre-signed URLs PR

Drew - Finished pre-signed URLs in VRRC dashboard - Added code qc actions to duap_insar_processor - LZA environment Cloud intake form

August 13, 2024 Drew - Finish s3 signed url PR fixes - Requested Dev LZA environment - Reaching out to AWS TAM re: s3 cost optimization - Milestone and final report writing

Tim - Deployed new Insar Hub version with special_handling_required fix - Further PR review (s3 signed URLs) - Start looking at automatically creating "status: new" interferogram records via Insar Hub

Mandip - Working on Rastertile generation in batches - Further PR review (s3 signed URLs) - Reprocessing definitive pairs

August 15, 2024 Tim - Adding SLC Orbit Data source field - Logic for IFG record status (i.e. new)

Drew - Fixes to Dashboard PR - Milestone report - Chilcotin RCM processing - Reykjanes MSBAS Processing - AWS Batch DUAP InSAR Processor

Mandip - Continuing Rastertile backlog batches 60-70% - Reviewing Dahsboard PR - Reprocessing Reykjanes - GC Logo in VRRC Dashboard

August 22, 2024 Tim - New IFG record updates - Now based on unique SLC ID - integrating changes into InSAR Hub

Chloe - Working on DUAP InSAR Processor - Cleaning up code and making changes

Mandip - RasterTiles for Reykjanes 5M4 - Adding GC logo to Dashboard - Next - test latest Dash version - Meeting about Chilcotin Landslide

Drew - Reykjanes Deformation Time-series - Chilcotin landslide monitoring - Working through Milestone report - Reviewing papers and reports

August 27, 2024 Mandip - GC logo Dashboard PR - Testing latest dash version - 2x new Reykjanes reprocess scenes (Definitive) - Processing Kilauea - Migrate rastertiles from landmass sandbox to vrrc-dev

Chloe - Working through duap-insar-processor

Drew - Working through Reykjanes data sharing - Doubtful move forward with AWS pro services - Milestone report and reviewing publications - RCM Standard Coverage Orders submission

August 29, 2024 Tim - Continuing IFG initial pairs working InSAR hub

Drew - Helping Chloe work through duap_insar_processor

Chloe - Working through duap_insar_processor - Volcano Interp workbench

Mandip - 2x Reykjanes scenes processed - Processing Kilauea -

Clone this wiki locally