CabuKcgCrawler

A crawler for download cabu kaohsiung data.

##How to install it##

• You must install Scrapy first. You can find how to install scrapy in Scrapy Install Guide.

• use git to clone this project.

   git clone https://github.com/codeforkaohsiung/CabuKcgCrawler.git

• use follow commands to prepare to run.

   git submodule init
   git submodule update

• you can crawel data as follow.

   scrapy list
   scrapy crawel District
   scrapy crawel 61B3

all you crawel data will write to /data folder