Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reassess partitioning queries by tablet location when using scan servers #2606

Open
keith-turner opened this issue Oct 10, 2024 · 1 comment

Comments

@keith-turner
Copy link
Collaborator

Execution of queries may use PushdownFunction which seems to partition queries based on tablet locations on tablet servers. When using scan servers these locations are not very meaningful for query planning. Looking forward to Accumulo 4 where tables can load tablets into tablet servers on demand attempting to obtain the location of an ondemand tablet would break the current PushdownFunction code.

What changes should be made to this code to make it work well scan servers and eventually on demand tablets?

@keith-turner
Copy link
Collaborator Author

keith-turner commented Oct 10, 2024

Seems like this code path can be toggled on/off by configuration here. Would using the SequentialScheduler be a good option when using scan severs, or should another type of partitioning be created for scan servers in addition to what is there for tablet servers?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant