Pipelines process overview - AtlasOfLivingAustralia/documentation GitHub Wiki

This is a general overview of the steps needed in processing data to be stored in the ALA biocache. Also the legacy biocache-store process is shown.

Pipelines data processing

This diagram shows the sequence of steps in pipelines for processing data.

Note: each transform creates it's own avro file, these are not shown in the above diagram.

Legacy Biocache Store processes