scrapyinstall - juedaiyuer/researchNote GitHub Wiki

scrapy安装

环境搭建

这里使用了Anaconda这款工具,个人使用方法

# 如果需要使用特定版本,请在Scrapy后面加上 ==XXXX  XXXX代表你需要的版本号
$ conda install Scrapy

激活环境

juedaiyuer@juedaiyuer:~$ source activate py2crawler
(py2crawler) juedaiyuer@juedaiyuer:~$

验证安装

$ scrapy
Scrapy 1.3.3 - no active project

Usage:
  scrapy <command> [options] [args]

Available commands:
  bench         Run quick benchmark test
  commands
  fetch         Fetch a URL using the Scrapy downloader
  genspider     Generate new spider using pre-defined templates
  runspider     Run a self-contained spider (without creating a project)
  settings      Get settings values
  shell         Interactive scraping console
  startproject  Create new project
  version       Print Scrapy version
  view          Open URL in browser, as seen by Scrapy

  [ more ]      More commands available when run from project directory

Use "scrapy <command> -h" to see more info about a command

source

⚠️ **GitHub.com Fallback** ⚠️