Admin Queues - mgtools/MetaProD GitHub Wiki

Queue Configuration

website_admin_queues

This page allows one to view all the files added to the queue system, their associated project, the filename, sample, status, error status, whether the file has been set to be skipped, and the associated job.

Description of Columns

ID: Internal ID for the filename.

Project: The associated project.

Filename: The filename for the queue entry (directories stripped).

Sample: The associated sample in the case of fractions. Set fractions to be the same sample.

Status: The current step for the queue entry.

Error: The error status for the queue entry. This will either be "No Error", "Retry", or "Failed". Files with the "Failed" file status have a problem that needs to be resolved.

Skip: Whether the file was set to be skipped and therefore not include in queue processing or analysis.

Job: The associated job in the case of HPC situations. Files can be set to different job IDs to allow spread out processing using queue software (e.g. slurm). For example, one can set some files to job 0 and some to job 1 and submit a batch for job 0 to slurm and submit a batch for job 1 to slurm.

It is recommended to not use this page to add a queue entry. Use the command-line command 'update_queue' to add entries because this will ensure all the proper directories and database entries are added.

Editing a Queue Entry

website_admin_queues_edit

Description of Fields

Project: The associated project. Visit the "Project" page to add a project.

Job: The job associated with the queue entry. See the description for "Job" above.

Filename: The filename associated with the queue entry. This should not be edited here.

Sample: The sample associated with the queue entry. See the description for "Sample" above.

Status: The status associated with the queue entry. This can be changed to rerun the file from an earlier step. It is highly recommended that if the file is on the "proteome" step, to not change its status to a "profile" step (and vice-versa).

Error: The error status associated with the queue entry. If a file has "Failed", this can be reset to "No Error" to try to re-run the file.

Skip: Whether or not the file should be skipped from processing or analysis. This is useful if a particular file is causing a problem.

Dates: Dates the queue entry was added, finished the "profile step" and finished the "proteome" step.

Total runtime: The total runtime (for all steps) for this queue entry.

RUN TIME: This section shows the run-times for individual steps. Do not add a "Run time" here. It will be added automatically.