Setup for Airflow Docker - Pardhu448/clix_dashboard_backend_AF GitHub Wiki

Following are the steps involved in setting up clix_dashboard_backend_AF:

1. Clone github repository of clix_dashboard_backend_AF in the same folder as clix_dashbaord_backend, clix_dashboard_ui and CLIxDashboard. Move into clix_dashboard_backend_AF directory
2. Set 'DOCKER_UID' argument in 'docker-compose.yml' file to user-id of current user of the host machine
3. Set host port of 'webserver' service to the available port, default is '8080'
4. Create all the required directories in clix_dashboard_backend_AF directory, which are mounted on airflow container:
   • run 'mkdir school_syncthing_data_live syncthing_data_static_vis state_level_data_logs state_level_data_logs/tools_temp state_level_data_logs/modules_temp state_level_data_logs/serverlogs_temp state_level_data_logs/vis_data'
5. Update following host specifc variables in clix_config.py file:
   • Host Username - username of the current user on the host
   • Host Server IP - IP address of the host machine. To be able to do ssh from airflow dockerfile
   • Host server password - to be able to ssh into host machine
   • backend db admin username - admin of postgres DB used in CLIxDashboard backend
   • backend db admin password - password of the same postgres DB
   • backend db port - port on which postgres DB is available
   • backend db name - name of the db used inside postgres DB
6. Then run 'docker-compose up -d'
7. Finally update 'clix_variables.json' with the following:
   • current_update_date_* : date on which this setup is done
   • prev_update_date_* : date since when syncthing data is available. With With these set all the data uploaded till today since the start of syncthing data is processed as soon as we start the scheduler in the airflow interface(explained in next section)