Sprint 28

Sprint Notes

VRRC Dashboard

• Coherence Matrix loading latency, Profile Code - Chloe
• Observation Log UI - backlog - Drew/Chloe
• Test latest dash version - backlog - Mandip
• Bilingual dashboard - backlog

VRRC API

• Implementing a observation log table 50% complete - backlog - Tim

• Populate legacy processed interferograms - backlog - Tim

• Add Status Field to Site endpoint - Tim

• Change status to 'unassigned' after threshold

• Implement coherence matrix route - backlog - Tim

• Implement baselines route - backlog - Tim

• Implement potential pairs route - backlog - Tim

DUAP-InSAR-Processor

• CDK for running processor in Batch - Tim

• Optimize Compute resources for DUAP-InSAR processing run - Mandip

• Add 'all pairs csv' generation workflow - Mandip/Drew

• Develop manual time-series workflow - Mandip/Drew

• Add displacement map rastertiles - new colour table required - backlog

• Check for downlinked orbits and run RCM_orb_filt.py - Backlog - Mandip

VRRC-InSAR-Hub

• Create Batch job in AWS to start processing - Tim

SSC LZA Environment

• Spin up CDK - Tim
• Setup RDS Database - Tim
• Creating IAM Roles - Tim

System Architecture

• Dedicated AWS (Staging) Environment - backlog - Tim/Drew

• Automate CDK deployment

  • PosGreSQL
  • PostGIS - manually implemented on RDS
  • VRRC API
  • VRRC InSAR-Hub
  • S3 Buckets
  • VRRC-Dashboard
  • Batch process for Duap Insar Processor - Tim

• Optimize S3 storage classes - Tim

  • Mohamed Amoura AWS Rep
  • Reorganize S3 files - Mandip
    • Consolidate raw data bucket everything into A4200_Volcano folders

• Develop rough cost estimate for API and DB - Tim

  • Running $140 USD/month as of Jan 29, 2024
  • Running $106 USD/month as of Feb 26, 2024
  • Running $145 USD/month as of March 18, 2024
  • Running $154.67 USD/month as of April , 2024
  • Running $209.46 USD/month as of May , 2024
  • Running $248.00 USD/month as of June , 2024
  • Running $288.00 USD/month as of July , 2024
  • Running $354.17 USD/Month as of August, 2024
  • Running $437.00 USD/Month as of September, 2024
  • Running $772.00 USD/Month as of October, 2024
  • Running $476.11 USD/Month as of November, 2024

AI

• Testing the COMET MODEL #1 #2 Testing/Reporting - Chloe
• Create Docker file - Chloe
• AWS Batch Infrastructure - Chloe

Documenting & Reporting

• Milestone Report due end of Fiscal - Drew
• Research Papers - Drew/Mandip

Administrative

• Reviewing AWS ProServe proposal - in progress
• Reviewing requirements for LZA - Not urgent
• Reid/Charles meeting re:operationalization - Drew
• Cloud Business Requirements (CBR) update - Drew

Demos

• Mandip - Optimize Compute resources
• Chloe - AI Results / AI - Docker
• Tim - Automatic processing via Hub
• Drew - New volcano site: Mount Fentaly Global Volcano Watch

Scrum Notes:

Tim - Deploying duap_insar_processor AWS Batch

Chloe - Running AI Detection model - re-running at new spatial resolution

Drew - Reviewing 2x papers - meeting with AWS s3 optimization - Milestone Report - Monthly costing

Mandip - gen_InSAR_pairs.py script - add baker to the dev api - if time permits, I will continue with optimization of compute resources