6 3 2024 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

6-3-2024

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
20-May-2024 Reporting, meeting, restart prod nginx to fix font CORS issue, deploy reingest and dataset delete fixes to prod, reindex prod, coord re: ldap conflicting account names from prod deploy, block IP probing prod, Add code to suppress stack traces from croissant failure and pen testing with bad oidc state token, add XMLValidator to DataCite XML test, find/fix several issues to get to successful DataCite submit for minimal dataset to test DataCite. 6
23-May-2024 Update autologout module, add security_review module, run on dev, fix contributorType tag for DC, investigate/try fixing Curate failure when PID update failed, fix geolocation 3
24-May-2024 Continue testing/fixing - get to working w/no files, fix off by 1 version to DataCite 6
28-May-2024 Test deaccessioned and file logic, fix all related bugs, coord, deploy to stage, create Google doc w/changes for discussion 6
29-May-2024 Check sec. updates, update jquery UI module 1
30-May-2024 Coord re: ARDM workshop, check prod rich html previewer for bug in comm. version (not applicable) 1
31-May-2024 Create DataCite PR branch, investigate changes needed for updating citation block with relationship type, investigate dvwebloader upload failure on prod, create fix that detects/fixes filenames with disallowed chars and warns user, discover, start investigating problem with UI upload failure with bad chars. 6

Operations

  • Update prod with fixes for CORS issue with fonts, reingest and delete dataset fixes
  • Investigate/block IP probing prod

SSO

  • Coord re changed user accounts - will handle if/when users request further change

Drupal

  • Updated autologout and jquery UI modules
  • Added security_review module and ran on dev - some recommended changes that could be pursued

Dataverse

  • Added code to suppress long stack traces when adding a croissant/json-ld header fails and when an OIDC failure occurs (a spoofed call with a bad 'state' secret)
  • Continued development of an updated XML submission to DataCite/DataCite export - improved tests, tested/fixed problems with files and deaccessioned data, one-off version issues,
  • Deployed DataCite changes to dev and stage
  • Created/shared doc with list of differences w.r.t. OpenAire export for review
  • Created branch for IQSS PR for DataCite XML changes
  • Verified rich html previewer is not affected by Firefox-only bug seen in community version (relates to the buttons to switch between running scripts or not, which our version automates)
  • Investigated/fixed issue in dvwebloader w.r.t. failure when filenames contain prohibited chars, identified related bug in normal UI where some date format issue causes the normal validation warning for bad chars to fail.

HEAL

  • Coord re panel - talk is 15 minutes plus ~5 for questions, slides are due EOD June 4th.

TKLabels

AnnoRep

Discussion

Plans

  • Keycloak update to 24.0.2
  • Finish work on metadata issue, e.g. adding a relationship type entry in metadata block, creating PRs #44 (more metadata to DataCite, etc.)
  • Work on MFA w.r.t. on authentication issue #43(MFA, etc.)
  • Fix Stata-14 ingest by allowing file inspection during direct upload or adjusting the Stata ingester.
  • Fix #113 if possible
  • Matomo - investigate event-level tracking via tag manager, remove non-working google scripts
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Ops
    • check missing globalidcreationdates and fix via /modifyRegistration or alternative
  • Dataverse
    • Make PR for guestbook adding datasetversion fix
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security