Sprint 24 - Volcano-Risk-Reduction-in-Canada/VRRC GitHub Wiki

Sprint Notes

VRRC Dashboard

  • Implement local and S3 raster tiles - Mandip - Merge conflicts! - IAM policy
  • Observation Log UI - Mandip/Chloe
  • Display full IFG network in time-series tab - Mandip
  • Site page seismicity - Mandip
  • Site page, current interferogram string not displayed - Mandip
  • Legends for overview/site page - Chloe
  • Test latest dash version - Mandip
  • Update summary table on page load - Chloe
  • Bilingual dashboard -
  • Add GC upper left logo -

VRRC API

  • Implementing a observation log table - Tim
  • Interferogram and associated table - Tim - [ ] Add orbitdatasource (Downlinked vs Definitive)
  • Implement coherence matrix route - Tim
  • Implement potential pairs route - Tim

DUAP-InSAR-Processor

  • Process backlog of rastertiles (landmass sandbox) - Mandip
  • Convert config.ini to .env - Chloe
  • Github actions - [ ] Action for Docker Container build - [ ] Flake8 and Pylint
  • General code refactor - Chloe
  • Local InSAR processing test - Drew
  • Check for downlinked orbits and run RCM_orb_filt.py
  • CDK for running processor in Batch - Tim
  • Insar sharing release + EULA - Mandip

Docker-Geoserver

  • Deprecate the use of geoserver - Drew

VRRC-InSAR-Hub

  • Flag to Ignore SpecialHandlingData in product upload - Tim
  • Create Batch job in AWS to start processing - Tim
  • Implement HyP3 processing/download for test site - Edgecumbe - Mandip - backlog
    • Try running on eodms-cli ec2 instance

SAR Data Sources

  • RCM MOU - Review backlog - Drew
  • Add Mount Baker to processing stack - Drew/Mandip

System Architecture

  • Dedicated AWS (Staging) Environment - backlog - Tim/Drew

  • Automate CDK deployment

    • PosGreSQL

    • PostGIS - manually implemented on RDS

    • VRRC API

    • VRRC InSAR-Hub - backlog

    • S3 Buckets - backlog

    • VRRC-Dashboard - backlog

    • Batch process for Duap Insar Processor - Tim

    • IAM Roles, Security Groups etc., cloudwatch events etc. - backlog

  • Reviewing AWS ProServe proposal

  • Reviewing requirements for LZA

  • Develop rough cost estimate for API and DB - Tim

    • Running $140 USD/month as of Jan 29, 2024
    • Running $106 USD/month as of Feb 26, 2024
    • Running $145 USD/month as of March 18, 2024
    • Running $154.67 USD/month as of April , 2024
    • Running $209.46 USD/month as of May , 2024
    • Running $248.00 USD/month as of June , 2024

Documenting & Reporting

  • Milestone Report due end of Fiscal - Drew/Nick

Administrative

  • Defining Global Volcano watch shapefile for CSA - Drew/Nick
    • High Frequency -
    • Medium Frequency - on hold
    • Low Frequency - on hold
    • MOU
  • Reach out to Hugo Drouin re: EODMS VAP API
  • JV Cloud Costs from GSC to CHIS

Demos

Mandip - Raster tile processing methodology / processing backlog / changes to dashboard Chloe - Tim - API changes - Interferogram table / potential pairs / etc Drew - Local testing of duap insar processor

Scrum Notes:

July 4th, 2024

Tim- Working through unit testing IFG table

Drew - Reviewing PR, working milestone

Mandip- Updating dashboard based on vrrc-dev API, new naming structure - Adding commits to seismic site page - Updating RCM orders - orbit source

Chloe - Glacier footprints and legend functionality

July 9, 2024

Tim - API unit testing logic - Final routes for IFG table

Chloe- VRRC Dashboard legend - legend and table show/hide buttons

Mandip- Seismic events in site page PR - updating orbit source -

Drew- Reviewing PRs - Writing milestone report - Training Cost Centre - Implementing GH Actions in duap-insar-processor

July 11, 2024

Tim - API unit testing logic - Final routes for IFG table - query IFG based to beam mode - Will be in Booth street Friday regarding laptop issues

Chloe - VRRC Dashboard legend done and merged - Duap insar repo, working on deprecating config.ini file - Tested duap docker container, works successfully

Mandip - Meeting with AWS to discuss S3 bucket policy - Possible IFGs in dashboard - Methodology for processing backlog of RasterTiles

July 16, 2024

Tim - IFG table implemented in VRRC-API - Additional IFG table functions

Mandip - Visualize possible IFGs - Issue with RCM order at Kilauea - Rastertile backlog methodology - presigned URLs

Chloe - refactoring duap_insar_processor repo - remove config.ini - adding unit tests

Drew - code review - budget forecasting - writing dry reports

July 18th, 2024 Tim - SLC potential pairs - 5 most recent pairs

Chloe - working on converting start.sh to start.py

Mandip - Working on wildfire CHIS work - Rastertile backlog methodology - Pre-signed S3 urls

Drew - Presigned S3 urls - Report writing - Budget - July 23, 2024 Tim - implemented auto pairs route in API - API solution for coherence matrix

Drew - Preparing presentation to ADM/DM visit next week - AWS Pro Services contract - Cloud Science Enablement Team - opening convo

Mandip - CHIS related work - Potential Pairs PR - InSAR sharing release - presigned URLs - backlog of rastertiles