Skip to content

Sprint 29

Drew Rotheram edited this page Jan 2, 2025 · 6 revisions

Sprint Notes

VRRC Dashboard

  • Coherence Matrix loading latency, Profile Code - Chloe/Mandip
  • Observation Log UI - backlog - Drew/Chloe
  • Test latest dash version - backlog - Mandip
  • Bilingual dashboard - backlog

VRRC API

  • Implementing a observation log table 50% complete - backlog - Tim

  • Add Unrest Status Field to Targets endpoint - Tim

  • Change unrest status to 'unassigned' after threshold

  • Populate legacy processed interferograms - backlog - Tim/Mandip

  • Implement coherence matrix route - backlog - Tim

  • Implement baselines route - backlog - Tim

  • Implement potential pairs route - backlog - Tim

DUAP-InSAR-Processor

  • CDK for running processor in Batch 80% complete - Tim
  • Add Interferogram Status update via VRRC-API - Tim/Drew
  • Add displacement map rastertiles - new colour table required - backlog

VRRC-InSAR-Hub

  • Create Batch job in AWS to start processing - Tim
  • Filter EODMS downloads to only download definitive orbits - Mandip

SSC LZA Environment

  • Spin up CDK - Tim - blocked by permissions
  • Setup RDS Database - Tim
  • Creating IAM Roles - Tim- blocked by permissions

System Architecture

  • Automate CDK deployment

    • PosGreSQL
    • PostGIS - manually implemented on RDS
    • VRRC API
    • VRRC InSAR-Hub
    • S3 Buckets
    • VRRC-Dashboard
    • Batch process for Duap Insar Processor - Tim
  • Optimize S3 storage classes - Tim

    • Reorganize S3 files - Mandip
    • Consolidate raw data bucket everything into A4200_Volcano folders
    • Run Queries provided by AWS - Mandip
  • Develop rough cost estimate for API and DB - Tim

    • Running $140 USD/month as of Jan 29, 2024
    • Running $106 USD/month as of Feb 26, 2024
    • Running $145 USD/month as of March 18, 2024
    • Running $154.67 USD/month as of April , 2024
    • Running $209.46 USD/month as of May , 2024
    • Running $248.00 USD/month as of June , 2024
    • Running $288.00 USD/month as of July , 2024
    • Running $354.17 USD/Month as of August, 2024
    • Running $437.00 USD/Month as of September, 2024
    • Running $772.00 USD/Month as of October, 2024
    • Running $862.98 USD/Month as of November, 2024
    • Running $452.04 USD/Month as of December, 2024

AI

  • Testing the COMET MODEL #1 #2 Testing/Reporting - Chloe
  • Create Docker file - Chloe
  • AWS Batch Infrastructure - Chloe

Documenting & Reporting

  • Milestone Report due end of Fiscal - Drew
  • Research Papers - Drew/Mandip

Administrative

  • Reviewing AWS ProServe proposal - in progress
  • Cloud Business Requirements (CBR) update - Drew

RCM Orders

  • Iteration 1F - submitted
  • Volcano Background Watch - Review
  • Reykjanes/Kilauea - resubmit - Mandip

Demos

  • Mandip - AWS S3 queries
  • Chloe -
  • Tim - Automated Processing with AWS Batch - InSAR hub
  • Drew - Publication Figures

Scrum Notes:

December 10, 2024 Tim - duap insar processor API IFG status updates

Chloe - Working on AI predictions for Reykjanes unrest events

Drew - Finalizing Chilcotin RCM SCWG Request - Writing up results and abstracts

Mandip - Cleaning up S3 buckets - Cleaning up old sites from API

Thursday December 12, Tim - Working on duap_insar_processor - Update API when processing

Chloe - finished processing the data and plotting all the charts. - I talked to Mandip and the 4 missing pairs are because they don’t have any disp images. Mandip reprocessed it in duap and I checked again this morning and the images still aren’t there, which means the images aren’t possible to generate.

Drew - Writing up CJES - Writing M report - Presenting to RCM Std Working Group - Upgrading Chilcotin Coverage - Plotting Chloe AI results - Writing up AI abstract

Mandip - Cleaning up S3 buckets and site API - Backlog InSAR processing - Away M-F next week

Clone this wiki locally