DropBox - uchicago-library/Digital-Special-Collections-Public GitHub Wiki
- The donor should grant the DAS and Head of Digital Special Collections view access to the folder.
- Add an entry to the SCRC accession log in order to claim or note an accession number for the accession. Entries for the digital media or born-digital portions of hybrid accessions should be recorded in the row immediately below the entry for the analog portion of accession. The following fields should be used in the accession log:
- Accession number. (Entries for the digital media or born-digital portions of hybrid accessions should use the same accession number as the analog portion of the accession. These accessions no longer have -dig or -digital appended to the accession numbers.)
- Date received (if logging digital media separated from an analog collection, this date should match the date the analog collection was received),
- Date accessioned
- FY accessioned
- Staff member assigned
- Type of collection
- Personal papers / records / collection
- Location (either “In Digital Accessioning” or “LDR”)
- Restrictions
- Create a stub record for the accession in ArchivesSpace. The stub record should include the following:
- Collection title
- Accession number
- Accession date
- General description of files transferred from DropBox
- Conditions governing rights and access (Consult the SCRC digital collection records and the paper files in the filing cabinets in compact for relevant restrictions)
- Provenance information that is known at the time materials are received
- Mark the ArchivesSpace accession record as in progress.
- Create stub collection, series, and sub-series records in ArchivesSpace. The collection record should contain a born-digital series and sub-series records for all digital media formats (floppy disks, optical disks, email, etc.).
- Assign the transfer a unique identifier. An item stub record should be created in ArchivesSpace that includes this identifier.
- Create a temporary folder in Staging by creating a copy of the Template folder inside Staging and renaming it with the EADID. Make sure to add the EADID to the SCRC EADID list if you created a new one.
- Within the new EADID folder you just created in Staging, create another folder with the accession number for the items you are transferring.
- Move the Admin and Data folders into that accession folder.
- Move any administrative documentation into the Documentation folder
- Configure rclone for a DropBox shared folder transfer
- Use rclone to transfer files from the DropBox folder to the Unprocessed folder in Staging.
- Dropbox supports its own hash type, use rclone to check that these checksums remain unchanged.
- Use HashMyFiles to generate SHA 512 checksums for the files and record the results in the Fixity checks
- The files in the Unprocessed folder should stay as an untouched “raw” copy of the files should we ever need to recover files or reprocess in the future. Using TeraCopy, make a copy of the contents of the Unprocessed folder and put it in the Working folder. This will be the working copy.
- Generate a file inventory for the transfer using TreeSize Pro. Save the inventory in the Documentation folder.
- Scan for duplicate files using TreeSize Pro.
- If any exact duplicates, hidden, or trashed files are found, they should be deleted. Record deletions in the ArchivesSpace item record. Save any reports generated by TreeSize Pro in the Log files folder.
- Upload files into Bulk Reviewer and scan for PII.
- Move any files with found restrictions to the appropriate Restricted folder in based on the length of the restriction period and note restrictions in the “conditions governing access” notes in the collection and item records in ArchivesSpace. Any reports generated by Bulk Reviewer should be saved in the Documentation folder.
- Using Bagger, bag files in the Working folder for transfer to Archivematica.
- Transfer materials to Archivematica. This is a mostly automated process in Archivematica and should complete with minimal intervention. Checksums will automatically be verified. Any resulting logs should be saved in the Log files folder.
- At the end of the transfer workflow, send the transfer to the Archivematica backlog. Note the move in the appropriate ArchivesSpace item record.
Right click or control click to open a larger view of this image in a new tab
- When you are ready to begin processing, find the transfer in the backlog tab of Archivematica and continue with the workflow.
- Start a Digital Object record in the appraisal tab of Archivematica. This should include the title, identifier, and conditions governing access if known. At this point in the workflow the title and identifier should both be the assigned unique identifier. Refer to the Description Guidelines for ArchivesSpace for further instructions.
- Use the Preview file and Examine contents features of the Appraisal tab to survey file contents for possible restricted administrative content such as financial materials, administrative records, or student files. Move any files with found restrictions to the appropriate Restricted sub-folder based on the restriction period. Note new restrictions in the “conditions governing access” notes in the Collection and Item records in ArchivesSpace.
- Use the Preview file and Examine contents features of the Appraisal tab to better understand contents of files. In ArchivesSpace, write scope and contents notes for the Collection and Item records. Note the total size and count of files in your scope notes (can use Bulk Reviewer, Hash My Files, and TreesizePro reports). Change the titles of Item records in ArchivesSpace to better reflect contents (“3.5-inch floppy disk, Ethnomusicology Book Project, Chapters 1-3”).
- Finalize the arrangement of files in the appraisal tab. All restricted files must be in the appropriate Restricted subfolder.
- Generate a file inventory in the appraisal tab for the AIP. Save this to the Access folder and add a file path to the file inventory to the appropriate ArchivesSpace Item record.
- Generate the Archivematica SIP. This is an automatic process in Archivematica and should complete with minimal intervention.
- Normalize files for access. Conversions should be noted in ArchivesSpace item and/or collection records.
- Connect the files from the transfer to the Digital Object Record.
- If ArchivesSpace functionality is not available, skip this step.
- Package the AIP in Archivematica. This is an automated process that should complete with minimal intervention.
- Download the packaged Archivematica AIP and transfer it to the the Preservation folder.
- Generate a file inventory for the AIP using TreeSize Pro. Save the inventory in the Documentation folder.
- Package the DIP in Archivematica. This is an automated process that should complete with minimal intervention.
- Download the DIP from Archivematica and transfer it to the the Access folder.
- Separate the Restricted folder in the DIP from the rest of the DIP contents and save it in the Access folder.
- Add the Archivematica transfer ID to the Digital Object Record in ArchivesSpace.
- Verify that descriptive metadata in ArchivesSpace is complete. Collection and Item level records should be finalized with information learned during the accessioning and processing workflow. Both should contain:
- Date information
- Total File size and count
- Scope and contents note
- Conditions governing access note
- Conditions governing use note
- Processing information note (choices to normalize file formats, redact or remove PII, if material could not be processed because of technical limitations, etc.)
- A link to a file inventory or a file path in each Item record.
- Make sure a file path to the DIP in the Access folder is listed in the Digital Object Record.
- Update the status of the accession from “in-progress” to “completed” in ArchivesSpace. Any additional information should be added to the accession record if needed.
- Update the entry in the SCRC accession log with the date accessioned, FY accessioned, and any restrictions added.
- After verifying that a server backup has occurred, any remaining working copies of files in the Working folder should be deleted.
- Once absolutely certain that all work with this accession has been finished, the SIP can be removed from the Archivematica dashboard.