10 21 2024 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

10-21-2024

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
14-Oct-2024 Reporting, meeting, work through MFA bugs/change requests 6
15-Oct-2024 Add link from /me/edit to keycloak account page, switch dev to use same realm name, update Google/Orcid urls, deploy latest to stage, check httpclient security issue, fix relationType bug in PR #10926, deploy, test on dev 5
16-Oct-2024 RelationType bug fix - add more detailed test, add mechanism to load test dataset md from json export, QDR Planning mtg 3
17-Oct-2024 Update Drupal upgrade module, investigate update failure/remove module_missing_message_fixer that appears to be the problem, cleanup dev disk 1

Operations

SSO

  • Work through change requests from testing including
    • find/fix css conflict between PatternFly (used in Keycloak) and Font Awesome (both use the fa class) that caused icon issues on the restart login link,
    • Added help link on OTP dialog,
    • Updated text about username==email on reg form,
    • Fixed logic issue requiring OTP when not needed,
    • Add link to Keycloak page from /me/edit to support resetting OTP setup,
  • Change dev to be closer to stage/prod keycloak config (realm name, etc.)

Drupal

  • Updated the upgrade module,
  • Removed the module_missing_message_fixer module which was causing some conflict that broke the site. I'm not sure I fully understand the issue since the update should just have added entry that indicated the module is Drupal 11 compliant. Regardless, the module is just used to clean up if/when a module is deleted before it is turned off (uninstalled) in the Drupal UI, so we don't need it often/only after a mistake and that can be corrected other ways if the module isn't fixed before we need it again.

Dataverse

  • Investigated a security issue with the Apache httpclient version we use. Looks like it will take a little time to address as the httpclient has evolved slightly. Doesn't look like a huge priority, but should be cleaned up at some point,
  • Fixed issue reported with including the relationType in DataCite XML. The root problem is that the code was using the display value, e.g. Is Cited By rather than the IsCitedBy value and the former (with spaces) is not in the DataCite schema. At QDR, the problem was masked due to a merge mistake in which the display values were broken (so QDR would send the IsCitedBy/no space version anyway). Both issues are fixed at QDR, deployed to dev/stage, and I created a PR and a new test (which should also make it easier to add tests for specific metadata configs in the future (.e.g. one can export the json metadata from a real-world test case and create a mock dataset in a dataset with those values in only a couple lines of code).

HEAL

TKLabels

AnnoRep

Discussion

  • FYI: DANS is working to be able to show subtitles in video previews - with the subtitle file(s) added as additional datafiles

Plans

  • Fix remaining bugs/make updates based on testing feedback for MFA #43(MFA, etc.)
  • Add version notes
  • Background work to change/remove deprecated Drupal modules in prep for 11.0.0
  • Fix Stata-14 ingest by allowing file inspection during direct upload or adjusting the Stata ingester.
  • Fix #113 if possible
  • Matomo - investigate event-level tracking via tag manager, remove non-working google scripts
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Ops
    • check missing globalidcreationdates and fix via /modifyRegistration or alternative
  • Dataverse
    • Make PR for guestbook adding datasetversion fix
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security