Scrapping the news website BBC.com using Scrapy framework & newspaper.
- Crawls BBC.com for articles.
- Collects Author,Date, Article, Headlines.
- REST for querying basic operations.
- Unittests
To run MongoDb in Docker. sudo docker run --name bbcmongo -d -p 27017:27017 -v ~/data:/data/db mongo
To rerun. sudo docker rm bbcmongo