Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ingester Configuration #28

Open
gtfierro opened this issue Jun 17, 2019 · 0 comments
Open

Ingester Configuration #28

gtfierro opened this issue Jun 17, 2019 · 0 comments

Comments

@gtfierro
Copy link
Owner

Configuration of the ingester is definitely a sore spot. Some ideas:

  • the "schema" field in the message can be used to suggest a plugin, which could then be fetched/loaded and used to archive data. Because of the protobuf-json translation, we could embed jq and have parsing logic defined in terms of jq programs. We aren't currently using the schema field for anything other than xbosproto/XBOS. Could also put this in the XBOS top level message
  • the "contextd" daemon saves an RDF representation of published resources. This engine could be integrated into the ingester and used to bootstrap the subscriptions
  • add default subscriptions to the ingester.yml file
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant