Reprocessing RMS Data - markmac99/ukmon-pitools GitHub Wiki

You may sometimes want to reprocess a Captured dataset for example if RMS crashed midway through or you have a new platepar file.

If RMS crashed, then it should automatically reprocess any missed folders after the next restart. Thus you should first try simply rebooting the Pi from the menu or commandline (never simply switch it off and on again).

However you may have a new platepar, or the above method may not work. You can still reprocess a folder as follows:

Open a terminal window and type

python -m RMS.Reprocess ~/RMS_data/CapturedFiles/folder-to-process

For example this will reprocess the data for the night of 2021-08-23, provided it still exists on the Pi.

python -m RMS.Reprocess ~/RMS_data/CapturedFiles/UK000F_20210823_194715_720619

Once reprocessed, data will be automatically re-uploaded to UKMON and GMN.

If the data is less than three days old then UKMON will include it in the next night's batch. Note however that GMN will not include any revised data in any analysis and UKMON will not process data older than three days. This is due to the huge data volumes which its too costly and time consuming to reprocess older data.