5 8 2023 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki

5-8-2023

Logged Tasks

                            Date             Task Hours (Main) Hours (EOLS) Hours (PII) Hours (QDAS)
1-May-2023 Reporting, install updated MDC JWTs from DataCite, fix multiple issues with MDC installs, run latest reports for Apr, get Citations, fix/deploy DV fix to handle old corrupt QDR datasets, investigate/test Drupal deploy to prod, update docs with MDC findings, fix/submit PR for #9346/clear metric api call 6
2-May-2023 Investigate ORCID integration, get/build ORCID plugin, setup sandbox account, start testing 4
3-May-2023 Update licenses on stage/prod (add ccby, reorder, change default) 1
4-May-2023 Update dev/stage Drupal core to 9.5.9 1
5-May-2023 Investigate/fix FT index failure skipping file, investigate storJ slow page load 2

Operations

  • Installed new DataCite JWT for Make Data Counts.
  • Investigated/fixed multiple migration related issues that had broken MDC processing across dev/stage/prod - missing counter user, path change for curl, name change for python
  • Ran MDC activity tracking and citation retrieval processing to catch up
  • Updated restart wiki docs with additional MDC info
  • Diagnosed Drupal deployment issue after machine upgrade (file syncing to new machine apparently turned some symbolic links into real dir/file entries), confirmed that deploy now works.
  • Updated/reordered licenses on stage/prod per Sebastian's request - added cc-by, put QDR licenses first and made the QDR standard license the default
  • Started investigating slow dataset load from a StorJ store.

SSO

  • Investigated ORCID integration, found ORCID keycloak plugin
  • Setup ORCID sandbox account, built custom version of ORCID-keycloak plugin for sandbox use
  • Started testing (ORCID login for new accounts now fails like Google, haven't yet created a local account which needs to be an @mailinator address)

Drupal

  • Updated Drupal core to 9.5.9 on dev/stage

Dataverse

  • Found/fixed/deployed solution for issue in newer DV code that caused a null pointer for old corrupt dataset entries (we have a few on prod from ~2017) that prevented some bulk operations that start by getting a dataset list.
  • Found/fixed issue with the clear metric cache api call - submitted #9346.
  • Investigated accessibility issues noted by Sebastian and found ways to implement fixes without having to make custom PrimeFaces fixes
  • Investigated/fixed issue reported by Sebastian where files with full-text indexing failures were not getting indexed at all.

AnnoRep

Discussion

Plans

  • Fix additional reported accessibility issue
  • Deploy indexing fix to prod and reindex
  • SSO - continue to explore/build OIDC options
    • Handle failure for Google login when no local account (unless/until supporting new accounts from Google)
    • Investigate ways to simplify user interface (multiple clicks to get through Keycloak)
    • Restore redirect to current page after login
    • Investigate creating a new account via Keycloak, i.e. starting from a Google or ORCID account
    • Try ORCID?
    • Investigate automating recovery from Drupal logged in /Keycloak&Dataverse logged out
  • Matomo - help with transition from Google
  • AnnoRep - explore round-trip, configure auto-start and log rotation
  • Dataverse
    • Make PR for accessibility fix (once finalized)
    • Make PR for guestbook adding datasetversion fix, deploy to stage
    • Continue towards guestbook at request based on ADA's original work
    • Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
  • Drupal - v10 - review compatibility and start updates.
  • QDAS Previewer
    • Updates per request
    • Investigate writing aux file/previewing lower-sensitivity version and/or other write options
  • TBD: FRDR Security