scrapy crawl test -s JOBDIR=data -0 items.csv watch -n 1 -d 'wc -l items.csv;du -h items.csv' 附数据 items.csv http://hackerxu.com/2014/09/07/scrapy-jd.html