6 1 2023 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

6-1-2023

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
22-May-2023 Report, fix chef github re: drupal8 backup, meeting 2
23-May-2023 Debug dataset page failures on stage, check prod backup - not updating to drupal8 2
24-May-2023 Merge indexing PR commits into develop, fix merge issues, test. 2
25-May-2023 Make d8 prod backup, merge indexing into v5.13-qdr branch, fix merge issues, deploy to stage 2
30-May-2023 Investigate slow selection on large dataset, outline slides for DCM 2
31-May-2023 Try speeding selection, roll back, update metatag, private_files_download_permission modules in dev/stage 3

Operations

  • Make manual backups of drupal8 on prod
  • Update chef repo to use drupal8 instead of drupal for database to be backed up - doesn't change the backup script on prod

SSO

  • Started slides for DCM talk on HEAL/SSO

Drupal

  • Deployed new metatag and private_files_download_permission modules to dev/stage

Dataverse

  • Merged work from community PR to speed indexing into develop and v5.13 branches, deployed to dev/stage, verified speedup that avoids page timeouts on stage.
  • Investigated reasons for slow updates/bad scaling when selecting files. Tried/rejected a simple fix. Currently believe that the root cause is the whole file table being regenerated after each selection. Changing that is probably pretty involved.

AnnoRep

Discussion

  • FYI: I'll be away June 5-11 (DCM mtg) and possibly sometime in late June.
  • @Seba - The /opt/backup_scripts/mysql script on prod is backing up the drupal database rather than the drupal8 database. I tried a local change and updating the recipe in ops_chef, but the change doesn't stay on prod. Can you fix? FWIW: I've made a few manual backups of drupal8 so we have recent copies.

Plans

  • Fix #115 if possible
  • Investigate selection speedups on dataset page
  • Deploy indexing fix to prod and reindex
  • SSO - continue to explore/build OIDC options
    • Handle failure for Google login when no local account (unless/until supporting new accounts from Google)
    • Investigate ways to simplify user interface (multiple clicks to get through Keycloak)
    • Restore redirect to current page after login
    • Investigate creating a new account via Keycloak, i.e. starting from a Google or ORCID account
    • Try ORCID?
    • Investigate automating recovery from Drupal logged in /Keycloak&Dataverse logged out
  • Matomo - help with transition from Google
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Ops
    • Clean out old corrupt test datasets
    • check missing globalidcreationdates and fix via /modifyRegistration or alternative
  • Dataverse
    • Make PR for accessibility fix (once finalized)
    • Make PR for guestbook adding datasetversion fix, deploy to stage
    • Continue towards guestbook at request based on ADA's original work
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • Drupal - v10 - review compatibility and start updates.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security