tmp some project directory explained - erdl/legacy-scrape-util GitHub Wiki

5. tmp/<some-project>

The tmp/ directory contains two project folders: dhhl-hobo-u12 and hobo-u12

dhhl-hobo-u12 is laid out as follows:

├── dhhl-hobo-u12
│   ├── archive
│   ├── errors
│   ├── inputs
│   └── raws

hobo-u12 is laid out as follows:

├── hobo-u12
│   ├── ABOUT.md
│   ├── archive
│   ├── errors
│   ├── inputs
│   ├── outputs
│   └── raws

tmp/<projectname>/inputs : this is where hobo input data needs to be placed for the current configuration of scrape-util to consume it

tmp/<projectname>/archive : after scrape-util has consumed the data, it will remove it from the inputs folder and place it in here so that the same data isn't read in again on the next run of the program

tmp/<projectname>/outputs : nothing is here, output actually goes to tmp/outputs

tmp/<projectname>/errors: data failed to be inserted will end up here. Unlike tmp/errors, which contains runtime error logs, tmp/<projectname>/errors contains rows failed to be inserted...

tmp/<projectname>/raws : currently nothing is here and the tmp/<projectname>/archive actually serves the purpose of a raw archive