scrapyinstall - juedaiyuer/researchNote GitHub Wiki
这里使用了Anaconda这款工具,个人使用方法
# 如果需要使用特定版本,请在Scrapy后面加上 ==XXXX XXXX代表你需要的版本号
$ conda install Scrapy
激活环境
juedaiyuer@juedaiyuer:~$ source activate py2crawler
(py2crawler) juedaiyuer@juedaiyuer:~$
验证安装
$ scrapy
Scrapy 1.3.3 - no active project
Usage:
scrapy <command> [options] [args]
Available commands:
bench Run quick benchmark test
commands
fetch Fetch a URL using the Scrapy downloader
genspider Generate new spider using pre-defined templates
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Create new project
version Print Scrapy version
view Open URL in browser, as seen by Scrapy
[ more ] More commands available when run from project directory
Use "scrapy <command> -h" to see more info about a command