Sprint 21

Sprint Notes

VRRC Dashboard

• Push PR for landing page changes
• Implement local and S3 raster tiles - Drew

VRRC API

• Develop concept for storing static masks - Tim - backlogged
  • Describe required masks - Nick/Drew/Mandip
    • https://github.com/Volcano-Risk-Reduction-in-Canada/duap_insar_processor/wiki/InSAR-Masks
  • Store glacial and waterbody footprint maps
• Add DEM entry to targets table - Tim - backlogged
  • Storing of DEM data - Tim
• Implementing a observation log table - Tim
• Add title field to SLC table

DUAP-InSAR-Processor

• single command average coherence matrix production- backlog - Mandip

  • args: target, method

• Gacos atm correction - Mandip - On Pause - develop workflow to apply a single atmospheric correction - Mandip - [ ] Reprocess 2-3 beam stacks to get files for atm correction analysis: Nick - backlog - incidence angle in map coords - IFG in RDC - DEM in RDC - Open conversation with Gacos Dev team

• RAiDER Atmospheric Correction - Mandip

  • Investigate use - Mandip
  • Generate test correction - Mandip
  • Document Weather model requirements - Mandip
    • ECMWF Costs
  • blocked by weather model access

• Raster Tiles - Mandip

  • Test on Dash leaflet - Drew/Mandip
  • Test on S3 directly - Drew/Mandip

• Automate InSAR sharing releases - Mandip

• Choose 3x currently unrestful volcanoes from RCM Global Volcano Watch and start processing stacks - Mandip

Docker-Geoserver

• Geoserver bug crashing unexpectedly
  • Investigate why it's crashing - Tim/Drew/Nick
• Migrate S3 IFG storage to EFS - Drew/Tim/
  • Investigate the use of pre-cached raster tiles

EODMS-CLI

VRRC-InSAR-Hub

• Implement EODMS product upload workflow
  • create database record in SLC table - 50%
  • Implement EODMS Ordering/Download
    • Flag to Ignore SpecialHandlingData
  • Download and move image product to S3
  • Create SQS job in AWS to start processing/
• Implement HyP3 processing/download for test site - Edgecumbe - Mandip - backlog
  • Try running on eodms-cli ec2 instance

SAR Data Sources

• RCM MOU - Review backlog - Drew

System Architecture

• Dedicated AWS (Staging) Environment - backlog - Tim/Drew

• Automate CDK deployment

  • PosGreSQL

  • PostGIS - manually implemented on RDS

  • VRRC API

  • VRRC InSAR-Hub - backlog

  • S3 Buckets - backlog

  • VRRC-Dashboard - backlog

  • InSAR Hub - backlog

  • IAM Roles, Security Groups etc., cloudwatch events etc. - backlog

• Develop rough cost estimate for API and DB - Tim

  • Running $140 USD/month as of Jan 29, 2024
  • Running $106 USD/month as of Feb 26, 2024

Documenting & Reporting

• Flow chart for deformation checking and escalation 50% - Drew
• Milestone Report due end of Fiscal - Drew/Nick

Administrative

• Defining Global Volcano watch shapefile for CSA - Drew/Nick
  • High Frequency -
  • Medium Frequency - on hold
  • Low Frequency - on hold
  • MOU
• Reach out to W.Mackinnnon and Global Affairs Canada Re: AWS Dev Environment Processing
• Reach out to Hugo Drouin re: EODMS VAP API
• Draft MOU with U-Bristol Research Team/COMET
• INSAR Data sharing EULA - Melanie/Drew

Demos

• Mandip - Early InSAR results on Global Volcano watch
• Tim - InSAR Hub - Eodms metadata
• Drew - Deformation Alerting flowchart
• Nick -

Scrum Notes Thursday February 29th, 2024 Tim - Finishing VRRC API Changes adding source title field for SLC table

Mandip - Raider, working through network issue to access weather model - blocked by network issues

Drew - Making figures SFU article - Responding Iceland met office -

Tuesday March 5th 2024

Mandip - Working on setting up about new sites / setup processing for these sites / automation - Automating InSAR sharing releases

Tim - Progress on vrrc-hub - can now acquire SLC metadata from EODMS and upload to VRRC API - Looking at strategies for running vrrc-hub automatically - currently investigating AWS Batch

Drew - Working on powerpoint slides, finishing up article for SFU - DG of HAOB visiting GSC Vancouver, Drew giving presentation - Imminent Iceland eruption - sending data to Iceland Met Office

Thursday March 7th, 2024

Mandip - Progress on setting up about new sites, issues with replicating results between SQS and duap docker - Automating InSAR sharing releases - Creating new RCM draft order of Reykjanes (continuation of current order + new tasking)

Tim - Working on dockerizing the vrrc-insar-hub and getting it up and running in AWS batch

Tuesday March 12th, 2024

Tim - Working on dockerizing the vrrc-insar-hub and getting it up and running in AWS batch, blockers with changing IP addresses

Mandip - Progress on setting up about new sites, issues with replicating results between SQS and duap docker - Automating InSAR sharing releases - Full day on RAiDER possibly on Wednesday or Thursday

Drew - Article for SFU is done - Working with Eliane pm EULA, blockers - Imminent Iceland eruption - sending data to Iceland Met Office - Field work in about 2/3 weeks, will be away for 4 days - Communicated with Will Mackinnon regarding AWS Dev env - Communicated with Charles Blais regarding project handover to CHIS