4 17 2023 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

4-17-2023

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
3-Apr-2023 Reporting, mtg, get sso logout and redirects between DV/Drupal working, shut off Shib redirects/passive logins, investigate adding attributes in Drupal, investigate catching s3 outage errors to keep homepage, etc. working. 4
4-Apr-2023 Debug issues with new dev machine, install docker-compose, restart services, transfer keycloak db, update drupal settings/code 3
5-Apr-2023 Continue fixing new dev issues - update Drupal, enable qdr_oidc_sso and add settings, update keycloak key, update mpm_prefork.conf, try updating Dataverse, find build issue, update Shib settings, report findings; merge with keycloak beta 11, report keycloak module issue #3352496 to include our remaining updates. 3
6-Apr-2023 Set READ COMMITTED on dev/stage, chown drupal_data, update DV oidc json, update DV db entries for my user 3
7-Apr-2023 Investigate/fix LDAP deprecation warning on stage, investigate adding attributes to profile/userinfo, try adding ldap attr for registration, update qdr_registration module to pick up all profile fields, test. Investigate/fix search issue on stage, update/deploy v5.13 with this fix and better S3 err handling to stage. 6
12-Apr-2023 Update old #6543 for MDC + legacy counts, AnnoRep bug fix for no title/comments, test, deploy to dev/stage 1 3
13-Apr-2023 Deploy ARS 0.0.5 to prod, check for MD5 files on prod, Add ldap reg to oidc branch, test Drupal login/account creation, investigate Dataverse account creation/mapping 3
14-Apr-2023 Fix given_name attr, add QDR params to first login page as a prequal to bypassing it, investigate google 502 failure, update keycloak session timeouts, redirect to / rather than user for now, restore mpm_prefork.conf on dev/stage (again) 4

SSO

  • Get SSO logout and redirects working between Drupal and Dataverse (using one client)
  • Disable shib code/passive login
  • Add LDAP attributes (from reg form) to Keycloak model and to profile and /userinfo endpoint response
  • Merge Keycloak beta 11, open Drupal issue #3352496 with our remaining fixes
  • Update qdr_registration module to use/display fields from profile managed as qdr_oidc_sso module data
  • Test Drupal login and registration, investigate OIDC new account handling/mapping in Dataverse
  • Fix naming of given_name attribute, prepopulate Dataverse form with QDR reg info (as a first step to bypassing it).
  • Investigate login redirect, shift hardcode from user to / for now

Drupal

Dataverse

  • Update #6543 PR for MDC + legacy counts as IQSS has decided to merge it
  • Add code to catch errors creating thumbnails when S3 is down, allowing main pages to display during an S3 outage

AnnoRep

  • Investigated/fixed issue causing a 404 failure when a docx had no comments and no title, deployed to dev/stage/prod

Operations

  • Investigated/fixed issues with new dev machine. Most were related to having an image a few days old (Drupal/DB config) with others related to software installs (docker-compose not yet installed, apache2 config reverting to default) or data (keycloak/mariaDB docker volume with database, drupal_data having wrong owner, Drupal ldap deprecation warning not (yet?) seen on stage).
  • Fixed search schema issue on stage (missed after machine update?)

Discussion

  • Dataverse build issue - same as before (now on dev) with no glassfish user
  • I'm starting to aim for an intermediate OIDC option where we keep LDAP and our current Drupal-based registration form and concentrating on getting the login/logout/registration/updating current users via LDAP, new Google/other provider users, UI look and feel etc. to a usable state as a deployable option. Continuing to remove LDAP (probably requiring a password update, replacing the Drupal reg form with one in Keycloak) and adding new functionality (ability to change passwords, MFA, etc.) could then be added over time.

Plans

  • SSO - continue to explore/build OIDC options
    • Investigate Dataverse adding new users based on OIDC profile
    • Investigate problem with Google login (which worked previously)
    • Investigate ways to simplify user interface (multiple clicks to get through Keycloak)
    • Restore redirect to current page after login
    • Investigate automating recovery from Drupal logged in /Keycloak&Dataverse logged out
  • Matomo - help with transition from Google
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Dataverse
    • Make PR for accessibility fix (once finalized)
    • Make PR for guestbook adding datasetversion fix, deploy to stage
    • Continue towards guestbook at request based on ADA's original work
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • Drupal - v10 - review compatibility and start updates.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security