Batch Uploading - wvulibraries/mfcs GitHub Wiki

Any form can be used as a Batch upload form. Things to keep in mind:

  1. All validation checks are turned off during batch uploads. This is so that required fields are not required, as they may be filled in later.
  2. If you are managing the IDNO for a form, you will need to manage on the batch upload as well. If IDNO numbers conflict the system will shut down until someone fixes the problem.
  3. If you manage IDNOs yourself, and you don't provide an IDNO, the system will populate it with the file name.
  4. If you don't provide a title, the system will populate it with the file name.
  5. Only Single Line Text fields (text input) and Paragraph text fields (text areas) can be editing on the batch upload form. Other types of fields will need to be edited by hand after the initial upload.

Uploading files

To upload files you can either drag and drop the files onto the upload box, OR you can upload the files via SFTP to the server. If you have very large files, or a large number of files, we highly recommend that you upload the files via SFTP.

Your system administrator will give you information on where to place the files.

When uploading the files create a directory (preferably with no special characters or spaces), and upload your files there. This should be done BEFORE loading the Batch upload page. If you create the directory after opening the page, it will not be listed in the drop down and you will have to reload the page.

Metadata

You can enter metadata in the preview form.

You can only enter metadata for Single Line input and Text area fields with the batch uploading.

Any data you enter in these fields will apply to all files uploaded into the system.

There is a dropdown arrow to the right of the preview on each line which lists a set of "standard" variables.

  1. Filename
  2. File Type
  3. File size

Metadata From Filename

this allows consistent filenames to be parsed for metadata. The data can then be used to populate fields in the from.

To use:

  1. Ensure that your file names are consistent. If they are not, the results will be unpredictable and likely incorrect. This may result in considerable cleanup effort on your part.
  2. select the "User RegEx to parse filename?" checkbox.
  3. Copy and paste an example file name into the "Example File Name" box.
  4. Create your regular expression and put it into the "regular expression" box.
  5. Please note: if you need help creating a regular expression you will need to contact the systems office. It is extremely important that you test your regular expression before submitting the form.
  6. Click the "Preview Reg Ex" button.

The results will be returned form the server just below the button. It will give a series of key/value pairs. The symbol on the left is what you would use to insert the value that is on the right.

You can then use the key, such as {1}, in the form preview on the right.

Conflicting IDNOs

If you are uploading to a form with System managed IDNOs, then the IDNOs will be entered consecutively in the system. Please note it is possible for someone else working on the form to enter an IDNO while the batch upload is processing and insert a record in your sequence.

If you are uploading to a form with a User managed IDNO field, you will be responsible for ensuring the integrity of IDNO numbers.

  1. If the IDNO field is left blank it will use the file name for the IDNO
  2. If there is a conflict with another IDNO it will append "_time()" to the end of the IDNO, where time() is a unix time stamp.

If MFCS had to modify your IDNO, it will provide it in a list after the batch upload as a link to the edit form. This will allow you to either edit it directly or make a note of it for later.