Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to specify dependencies without foreign keys #32

Draft
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

mlb6
Copy link

@mlb6 mlb6 commented Dec 23, 2020

With this PR I'm trying to fulfill the need that our projects require to be able use SnakeDumper.
We have a more than 300 tables with billions rows. Most of the tables have foreign keys, but some dont have them. We cannot only rely on foreign keys to look for dependencies between tables.
Because of this, some tables are dumped completely. We cannot dump everything as it would be too slow.

The aim of this PR is to provide :

  • the ability to specify dependencies without foreign keys.
  • the ability to specify "dynamic" dependencies. (Look at the demo.yaml or the unit test for example)
  • the ability to use AND and OR operators as filters
  • fix the isNull and isNotNull filter

This pull request is still a draft (requires more testing, and reviews from my team), but comments are welcome.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant