Scrape Last Modified Date

[Xelloss-nakama]

It would be useful to add a date in the "scraped" note field saying when was the comic scraped (as new comic info is usually added weeks after the time we scraped some comics)

For example: Scraped metadata from ComicVine [CVDB459159] on 12/12/15 -> when we scrapped it

Also, if possible, it would be useful and option to add when was the comicvine page from where we are scraping the info last modified... (which I think is a field in the api), so we know which comic info was modified from our last scrap

For example: Scraped metadata from ComicVine [CVDB459159] on 12/12/15 (web last modified 12/1/15) -> when the info was last updated in the site

[Xelloss-nakama]

ok, I see now that the first option was already a feature with an advance option... sorry XD

[boshuda]

I actually modified my personal copy of the scraper to add a custom field to save the last scraped time. I'm so lazy, and find github to be confusing enough, that I haven't created a patch (pull?) request. Maybe I'll get off my lazy ass and do it, but probably not.

To your second point: I believe comicvine doesn't indicate when the entry was last updated in the API. They might put it on the web page, but that would require web-scraping, which got the app temporarily banned a while ago. However, I'm not sure about that.

[Xelloss-nakama]

I look at the api documentation yesterday and it does now