batch_looper - krstphrrr/ingesterv2 GitHub Wiki

creates an exhaustive list of tables across all dimas in a folder and then uses looper to gothrough the list of tables and create csv's for each.

arguments: folder containing the dimas, projectkey, development boolean(is it development - true, or production - false, postgres boolean ( send to postgres - true, or save locally as csv's - false)

sequence of operations:

1. table_collector gathers all the tables inside the dima file

2. looper extracts a single table from all available dimas

3. main_ingest sends to postgres database