Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DAG Graph Pagination #159

Open
AnalogJ opened this issue Nov 17, 2023 · 0 comments
Open

DAG Graph Pagination #159

AnalogJ opened this issue Nov 17, 2023 · 0 comments

Comments

@AnalogJ
Copy link

AnalogJ commented Nov 17, 2023

Hey @dominikbraun
First, thanks again for writing this library, its been incredibly helpful in my Fasten Health project!

I know that this might not be a common use-case, but we're creating a massive DAG containing references to every single medical record associated with a patient. In some cases this can get to be 10,000s of records. Thankfully this can still be done in a couple of seconds, so its still reasonable to generate the DAG just-in-time.

Because of the way we display the expanded data to the user, we need to paginate the results.

Currently we do the following:

  • populate the DAG using references.
  • inflate the root vertices in the DAG (do DB queries for the full data, instead of just the reference/id information)
  • sort the root vertices (for consistency when paginating)
  • determine the page window (selected root DAG vertices)
  • inflate any descendant vertices for the selected root vertices
  • return the results

This doesn't seem to be working as expected. Do you have any ideas for how we can paginate though a massive DAG?

@AnalogJ AnalogJ changed the title Pagination DAG Graph Pagination Nov 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant