Running Pipeline on Computers with Display - TBDM/ju GitHub Wiki

Updated: Apr. 15th, 2017

  1. Build up scraping environment. Notice that pyvirtualdisplay and xvfb are NOT required when running pipeline on computers with display.
  2. Clone latest codes from GitHub.
  3. Put tbdmConfig.py and tbdmSetting.py from Coding Channel on Slack under the git repo.
    Remember to specify WHO_IAM as [NAME-MACHINE] in tbdmConfig, like [YMa-Aliyun].
  4. Run tbdmDISPipeline.py (tbdmPipeline is for CVMs with no display, so it will open up a useless virtual display service).
  5. Run tbdmRedisCheck.py for brief report on task status in Redis.
    To stop Pipeline, create a folder with name stopPipe under the git repo.