9 12 2022 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki
9-12-2022
Logged Tasks
| Date | Task | Hours (Main) | Hours (EOLS) | Hours (PII) | Hours (QDAS) |
|---|---|---|---|---|---|
| 29-Aug-2022 | Report, mtg, set storj for requested dataset | 1 | |||
| 31-Aug-2022 | Check/start fixing sitemap cert issue | 1 | |||
| 1-Sep-2022 | Update sitemap certs, investigate logs from last night, add sec updates to DV develop | 2 | |||
| 2-Sep-2022 | Deploy jsoup sec update | 1 | |||
| 6-Sep-2022 | Fix python3 link on dev, review TAB materials/minor edits | 1 | |||
| 7-Sep-2022 | TAB mtg, review Drupal sec announcements, update multiple modules for Drupal, deploy to dev/stage. | 2 | |||
| 8-Sep-2022 | Add outage announcement on prod, add comments in refi js, start adding back links/other table logic | 3 | |||
| 9-Sep-2022 | Fix filter logic, test/debug, add backward link search, start investigating pagination with filtering. | 6 |
Operations
- Added storJ for requested dataset
- Added new cert required for sitemap generation, cleared tmp files to restart sitemap updates
- Investigated logs w.r.t. outage - high rate bot/foreign traffic, but no clear attack/specific call(s) causing issue
- Dev was using older python - updated
- TAB prep/mtg
- Added outage announcement on prod for today's test
Drupal
- Updated multiple modules, deployed to dev/stage (no applicable security announcements)
Dataverse
- Added multiple security-related library updates to dev/stage - mostly routine
QDAS
- Started documenting code
- Finished ability to sort based on any table
- Fixed filtering bug w.r.t. pagination and added backward filtering (i.e. you can now filter sources based on the user and users based on a source even though the source->user link is only 1-way)
Discussion
- FWIW - autovacuum has triggered a second time (9/9/22). The displayed count is currently 30 less than actual (out of 90K+). Autovacuum looks like a good fix.
- Is storJ/prod being backed up to Syr?
Plans
- QDAS Previewer
- Updates per request
- Investigate writing aux file/previewing lower-sensitivity version and/or other write options
- AnnoRep - continue to explore/fix docx/pdf github issues
- Deploy updates to dev/stage/prod
- Dataverse
- Investigate guestbook at request design ideas
- Popup info accessibility - IQSS likes the recommendations from the source I linked to, so this can be implemented along those lines.
- Still want to investigate the guestbook responses re version info not being included.
- TBD: FRDR Security
- Other tasks as discussed in strategic planning