Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

API? #4

Open
hejjoe opened this issue Aug 24, 2022 · 4 comments
Open

API? #4

hejjoe opened this issue Aug 24, 2022 · 4 comments
Labels
question Further information is requested

Comments

@hejjoe
Copy link

hejjoe commented Aug 24, 2022

Will there be an API to automatically pull data from the EP, or how will it be possible to include new datasets in automated workflows?

@andrea-perego andrea-perego added the question Further information is requested label Aug 29, 2022
@andrea-perego
Copy link
Contributor

@hejjoe , data will be available from REST APIs once the European Parliament's Open Data Portal will be launched.

About "automated workflows", do you have in mind any specific use cases?

@hejjoe
Copy link
Author

hejjoe commented Aug 29, 2022

A case could be: Let me pull and reuse the data from the latest plenary session, as soon as it is available.

E.g.
https://github.com/OpenParliamentTV/OpenParliamentTV-Parsers
https://github.com/ungeschneuer/plenum_first_said

@tttp
Copy link

tttp commented Sep 15, 2022

let me add ours to the list:
https://github.com/TechToThePeople/parlparse ;)
used for mepwatch.eu

the problem we face:

  1. we don't know when the EP publishes a new rollcall, we can't even rely on the calendar, as there are some plenary days without rollcalls (eg mondays)
  2. we need to scrape the EP website and there is no up to date computer readable list of MEPs as far as we know

@hejjoe, beside a good structure (and this repository goes in the right direction, well done), what is still unclear is:

  • where are you going to publish this data (api/url)
  • is there a metadata explaining what is updated where (eg new MEP, new plenary)?
  • is there a plan to give early warnings on data schema changes?

@andrea-perego
Copy link
Contributor

@hejjoe , @tttp , thanks for contributing these use cases.

About notifications, which mechanisms do you suggest? A traditional RSS / ATOM feed, LDN (https://www.w3.org/TR/ldn/), or other solutions?

@tttp , about your questions:

  • where are you going to publish this data (api/url)

They will be available via the API of the European Parliament Open Data Portal.

  • is there a metadata explaining what is updated where (eg new MEP, new plenary)?

We plan to release a new version of the relevant datasets whenever changes occur. These datasets will be documented by using DCAT, but we don't plan to describe the actual list of changes.

Do you have any suggestion on how to deal with this?

  • is there a plan to give early warnings on data schema changes?

Thanks for raising this issue. The schemas will be maintained on GitHub, where changes will be documented before the release of new versions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants