5 3 2021 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

5-3-2021

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII)
26-Apr-2021 Report, meeting, multipage support fix start/end limitations, consolidate code, cleanup logging, document code. 1 4
27-Apr-2021 Refactor AR to prep for pdf conversion/highlight removal, implement creating stripped pdf, only read file once, test/debug/fix 5
28-Apr-2021 Finish testing, use longer buffer, setup logging, handle delete failures, update DV deleteAux error handling, deploy new ARServer, document, investigate/fix login redirect issue 2 3
29-Apr-2021 Update 5.4.1 on stage with latest fixes, investigate payara not running, investigate/deploy composer sec update to dev/stage 3

Summary

Operations:

  • Updated/synced the 5.4.1-qdr and 5.4.1-qdr-dev branches and deployed the latest updates to stage
  • Investigated Payara process failure during/before update (no conclusion)
  • Investigated/deployed composer security update for Drupal (shouldn't be a big concern for us given our configuration, but it is deployed to dev/stage and could/should go to prod on the next update)

Dataverse:

  • Investigated/fixed an issue related to SSO and confused login state between Drupal and Dataverse and odd redirects after session timeouts. Added a mechanism to remove a cookie and thereby force a passive login check when a Dataverse session ends (timeout or server restart) which should keep things in sync.

AnnoRep:

  • Added code to find comments on all pdf pages
  • Cleanup, used logger instead of printing to system out
  • Refactored the code to read the pdf document once and generate both the annotations file and a pdf version with the comments removed
  • Tested/debugged
  • Switched to scanning for comments with a minimum 1K buffer for efficiency
  • Improved the error handling if/when only one of the two annotation/stripped pdf files are created or when these files have been deleted at Dataverse (w/o using the AnnoRep API)
  • Deployed the updated server on dev, added documentation, and announced on slack

Discussion:

Plans

  • Improve Archiving URL
  • Deploy 5.4.1 to prod when ready
  • Anno-Rep work
    • Compare w/ Hypothesis selectors

Still TBD:

  • Drupal 9, Composer 2-->3