Running Pipeline on Computers with Display - TBDM/ju GitHub Wiki
Updated: Apr. 15th, 2017
- Build up scraping environment. Notice that
pyvirtualdisplay
andxvfb
are NOT required when running pipeline on computers with display. - Clone latest codes from GitHub.
- Put
tbdmConfig.py
andtbdmSetting.py
from Coding Channel on Slack under the git repo.
Remember to specify WHO_IAM as [NAME-MACHINE] intbdmConfig
, like [YMa-Aliyun]. - Run
tbdmDISPipeline.py
(tbdmPipeline
is for CVMs with no display, so it will open up a useless virtual display service). - Run
tbdmRedisCheck.py
for brief report on task status in Redis.
To stopPipeline
, create a folder with namestopPipe
under the git repo.