Best Practices - Unidata/LDM GitHub Wiki

  • Size the product-queue (LDM registry parameters /queue/size and /queue/slots) sufficiently large so that the age of the oldest product in the queue is greater than the maximum latency parameter (/server/max-latency). Once you get close enough, set the /reconciliation-mode parameter to either increase queue or decrease maximum latency. The ldmadmin addmetrics and ldmadmin plotmetrics commands can help determine when you're close.

  • Have sufficient physical memory on the LDM computer to allow the product-queue to be completely contained in memory.

  • When practicable, have two REQUEST entries for the same data to two, different, upstream LDM-s.

  • Execute data-product ingesters via EXEC entries in the LDM configuration-file so that the LDM process-group will be signaled when a new product is inserted.

  • Consider splitting a large-volume REQUEST entry in the LDM configuration-file, ldmd.conf, into multiple, smaller, disjoint entries.

  • Favor doing your local processing of data-products by pqact(1) on a computer that's not relaying data.

  • If you process a lot of data-products locally on the computer via pqact(1), then consider having multiple EXEC pqact... entries in your LDM configuration-file -- each using a different, feedtype-specific pqact(1) configuration-file and having a different -f feedtype option. This will reduce the size of each pqact(1)'s configuration-file and, consequently, the time spent attempting to find a matching entry.