3 1 2021 Tech Team Report - QualitativeDataRepository/TechnicalTeam GitHub Wiki
3-1-2021
Logged Tasks
| Date | Task | Hours (Main) | Hours (EOLS) | Hours (PII) |
|---|---|---|---|---|
| 22-Feb-2021 | Report, mtg, refactor annorep code, start impl of poi docx->pdf, allow download of aux for non-tab files | 1 | 4 | |
| 23-Feb-2021 | Update PRs, investigate converter modules, deploy convert_bundle to dev, investigate prod failure/clear disk space | 3 | ||
| 24-Feb-2021 | Investigate prod failure, make space, partially clear /tmp, discuss periodic clearing, log issues, snapshot backup proposal | 2 | ||
| 25-Feb-2021 | AnnoRep- update POI, investigate lib errors/compatibility, fix stream issue | 2 | ||
| 26-Feb-2021 | AnnoRep - add docx4j, write POC code to parse .docx | 4 |
Summary
Dataverse
- Updated open pull requests (merge with latest dev, so they show no conflicts/test failures while awaiting review/merging)
- Reported #7632 - module/classpath conflict warnings showing in Eclipse IDE. Created PR #7636 to collect fixes (library updates and/or excluding problematic dependencies) as they are found. (Right now, this are just a nuisance in that they appear the same as 'real' broken code.)
AnnoRep:
- Implemented call to create pdf from docx - reading specified file from Dataverse and writing pdf as an aux file
- Reviewed docx libraries, selected docx4j and started writing code to read/report on comments, anchor text, etc.
Operations:
- Investigated prod failure (/tmp ran out of space due to no periodic deletion), cleaned up some of the older files to create space (94% -> 72% used, up to 73% since last week)
- reported a 0 byte file issue from logs (while investigating the above)
- looked through/commented on backup proposal (esp. w.r.t. restoring dev/stage)
##Discussion:
- Automated cleaning of older files in /tmp
Plans
- TAB mtg
- Anno-Rep work -- continue docx parsing to get generate and then store an annotations file (as aux file in dataverse) -- start deploying service on dev once the basics are in place -- support use of Dataverse API as needed
Still TBD:
- Drupal 9/composer 2/3