Subscribe to Google Scholar URLs

[boonebgorges]

Google Scholar doesn't offer RSS feeds for profiles or search terms. But the markup of those pages is straightforward and predictable enough that we can parse it and check it like an RSS feed:

https://scholar.google.com/scholar?hl=en&as_sdt=0,14&q=%22digital+humanities%22&scisbd=1 (search term)
https://scholar.google.com/citations?hl=en&user=J9uOSc8AAAAJ&view_op=list_works&sortby=pubdate (profile)

We'll need some new mechanisms for recognizing when someone is adding a Google Scholar link and informing them of the fact, and some updates to the Add Feed interface to indicate that we support these sorts of "feeds". See #1185. We may also need some sort of internal abstractions to represent "feeds" (ie external URLs that need to be checked regularly for new content) that are not RSS feeds; see #685.

[boonebgorges]

Note that I don't want to PF to be in the business of scraping all sorts of subscribe-able URLs. But Google Scholar is likely to be stable enough and useful enough to make it worth the effort.