- Clone the repo into the EC2 instance and cd into wrapper-src
- Create a folder for log files (E.g. logs)
- Add configuration details into a json file (E.g. config.json)
- Run the command 'nohup python3 wrapper.py -c <config file> -lf <logfile> > jobs/std.out 2> jobs/std.err < /dev/null &' to start the process in the background
- To extract a particular attribute from an html tag
"content_filter_params": [
{
"tag": "<tag name>",
"attribute": "<attribute name>",
"value": "<attribute value>",
"type": "<attribute to extract>",
"target": "<target field>"
}
]