5 9 2022 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

5-9-2022

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
2-May-2022 Investigate/fix Dataverse outage on prod, reporting, meeting 4
3-May-2022 Fix stage-aws URLs in menus and text, update license names, debug/fix password reset issue/deploy to dev/stage/prod, update solr to 8.11.1 on dev/stage, update solr service to use link, reindex, check index status, clear disk space on dev, investigate counter-processor failure to send to DataCite. 6
4-May-2022 Investigate solr changes, setup new solr for prod, JWT updates on dev/prod, rerun 10-21 to present on dev (cp 0.1.04), install python/dependencies/counter-processor-0.1.04 on prod, update geomind, cronjobs, etc. to run new version, start processing backlog to DataCite. Edit Anno-Rep/QDAS abstract to DV mtg. 6
5-May-2022 Deploy Drupal/DV to prod, update composer on prod, fix nice_menus drush error, swap to new solr, change solr.service, track indexing progress, add licenses, update icons, investigate current termsofuse entries, remove unused pubIdtypes (from earlier bad mblock update) 5
6-May-2022 Investigate/fix CP issue, deploy on stage, test, check indexing on prod. 2

Drupal

  • Investigated/fixed issue reported with password reset - changes at some point to where the one-time token is stored broke our SSO password reset form (not seeing the token, the form assumed a normal password change which has the required current password field). Deployed fix to dev/stage/prod.

Dataverse

  • Added counter-processor-0.1.04 support to the 5.10.1-qdr branch
  • Edited AnnoRep/QDAS abstract

Operations

  • Investigated/fixed DV outage on prod (restart had deployed old postgres 9.6 db on default port - changed to let postgres 13 have that port, restarted dbs, restarted DV)
  • Updated stage-aws URLs still in Drupal db/documents to match new URL - presumably had been there since the change to stage.qdr.org but just not noticed/reported
  • Updated license names/icons (drop QDR from name, clearer versions) on dev/stage/prod for QDR standard/controlled access licenses
  • Updated to use solr 8.11.1 on all machines, switched to using a symbolic link to avoid having to update the service entry going forward. Reindexed.
  • Cleared space on dev by removing old wars
  • Installed pythos3.9, configured counter-processor 0.1.04 on all machines
  • Investigated counter-processor failures to send to DataCite, deployed new JWTs, re-ran back-months with 0.1.04
  • Deployed latest Drupal/DV to prod with various cleanup/minor tweaks (see 5-May entry)

Discussion

Plans

  • AnnoRep - continue to explore/fix docx/pdf github issues
    • Deploy updates to dev/stage/prod
  • Ops
    • Deploy cp 0.1.04 support to prod
    • Get custom terms spreadsheet, convert prod datasets with custom terms to use QDR license?
  • Dataverse
    • StorJ testing
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
    • QDAS planning/design/prototyping
      • Add error handling for format variations
      • Assess whether zip access is enough/project/other files need to be cached as aux files, etc.
    • Still want to investigate the guestbook responses re version info not being included.
  • TBD: FRDR Security
  • Other tasks as discussed in strategic planning