2 19 2024 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

2-19-2024

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
12-Feb-2024 Reporting, meeting, test search config changes, investigate/fix reported issue w.r.t. restricted files, investigate/report remaining search issue w.r.t. multiple words used as search term, update solrconfig in github to remove version dir, deploy solrconfig update and keycloak 23.0.6 across dev/stage/prod. 6
13-Feb-2024 Create Uningest/Reingest PR, update MDC upload.py script to fix error uploading to DataCite 2
14-Feb-2024 Investigate CKEditor sec warning, Investigate prod search error, try reindex fix, change Unigest PR per review 2
15-Feb-2024 Turn fulltext off on prod, investigate highlight settings, investigate missing email in message. 2
16-Feb-2024 Investigate email verify issue, propose fixes, investigate search - find highlighter change that appears to work, coord, coord re: HEAL DCM slides, merge latest develop, remove bad flyway, fix test, deploy updates to dev/stage 4

Operations

  • Deploy keycloak 23.0.6 across all machines - fixes Java sec issue

SSO

Drupal

  • Investigate CKEditor security warning - appears to affect older version we don't use

Dataverse

  • Investigated remaining search issues - after some partial fixes, the (hopefully) final fix appears to be to restore the 'original' lucene highlighter. Evidently, the new default highlighter can return unexpected classes (leading to a class cast exception). This also appears to fix #117.
  • Create Uningest/Reingest button PR: the community is requesting these buttons which QDR adopted a couple years ago. I made a quick PR of the QDR changes in response. Should go through QA this week (already reviewed)
  • Investigate missing link in 'verify email' email. It looks like this is due to QDR removing the required text string as part of suppressing the Dataverse welcome email. Since email verification should be done via Keycloak at this point, I proposed hiding the button and verify status rather than fixing the email.
  • Merged latest ~6.1.1 Dataverse, fixed flyway conflicts, deployed updates to dev/stage

HEAL

  • Coord re slides for DCM 2024 talk

AnnoRep

Discussion

  • Build issues with new composer - any updates?

Plans

  • Continue working on authentication issue #43(non-email account id, MFA, etc.)
  • Work on metadata issue #44 (more metadata to DataCite, etc.)
  • Fix Stata-14 ingest by allowing file inspection during direct upload or adjusting the Stata ingester.
  • Fix #113 if possible
  • Matomo - investigate event-level tracking via tag manager, remove non-working google scripts
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Ops
    • check missing globalidcreationdates and fix via /modifyRegistration or alternative
  • Dataverse
    • Make PR for guestbook adding datasetversion fix
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security