CDR Tools - PADME-Experiment/padme-fw GitHub Wiki

• The CDR Data Servers
• The CDR Central Server
• CDR Setup
• Starting the CDR service
• Stopping the CDR service
• GRID Proxies
• CDR Tools

VerifyRunsToRemove

VerifyRunsToRemove compares the current content of the DAQ data servers (l1padme3 and l1padme4) with the files already stored on the CNAF Tape Library and reports a list of run directories which can be safely removed from the data servers.

The tool syntax is:

[leonardi@padmeui cdr]$ ./VerifyRunsToRemove -h
VerifyRunsToRemove [-s server] [-c] [-Y year] [-v] [-h]
  -s server  Select a single DAQ data server to check (default: check both servers)
  -c         Enable checksum verification of files (safer but VERY SLOW)
  -Y year    Look for data from given year (default: current year)
  -v         Run in verbose mode (repeat to increase verbose output)
  -h         Show this help message and exit

If no arguments are given, the script will get a full list of the rawdata files on the data servers and print a line for each run directory specifying if that directory can be deleted or not. E.g.

[leonardi@padmeui cdr]$ ./VerifyRunsToRemove
l1padme3 - run_0000000_20181126_133741 - can be removed
l1padme3 - run_0000000_20181126_161842 - can be removed
l1padme3 - run_0000000_20181127_060739 - can be removed
l1padme3 - run_0000000_20181127_112351 - can be removed
l1padme3 - run_0000000_20181128_002515 - can be removed
l1padme3 - run_0000000_20181128_010424 - can be removed
l1padme3 - run_0000000_20181128_020950 - *** DO NOT REMOVE ***
l1padme3 - run_0000000_20181128_095733 - *** DO NOT REMOVE ***
l1padme4 - run_0000000_20181120_024022 - can be removed
l1padme4 - run_0000000_20181120_145341 - can be removed
l1padme4 - run_0000000_20181121_030917 - can be removed
l1padme4 - run_0000000_20181121_101253 - can be removed
l1padme4 - run_0000000_20181121_112534 - can be removed
...etc...etc...

Please note that, to improve performance, files are just checked for existance in the CNAF Tape Library. The -c option enables the much safer but much much slower adler32 checksum verification of the compared files. If you feel paranoid and there is plenty of time before the data servers fill up, you can enable this feature. However note that an adler32 checksum verification is active during each step of the PadmeCDR file copying process, so in principle this check is redundant.

VerifyRun

VerifyRun checks if all files of a given run have been correctly copied from the DAQ server to LNF and CNAF. As it retrieves the checksum of each file from the three sites, it is quite slow. Any file missing from a site or with the wrong checksum is reported.

The tool syntax is:

[leonardi@padmeui cdr]$ ./VerifyRun -h
VerifyRun -r run -s server [-c] [-Y year] [-h]
  -r run     Select run to verify
  -s server  Select DAQ data server where run can was stored
  -Y year    Look for data from given year (default: current year)
  -v         Run in verbose mode
  -h         Show this help message and exit