Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(hydro_std): send_partitioned operator and move decoupling #1652

Merged
merged 11 commits into from
Jan 16, 2025

Conversation

davidchuyaya
Copy link
Contributor

Allows specifying a distribution policy (for deciding which partition to send each message to) before networking. Designed to be as easy as possible to inject (so the distribution policy function definition takes in the cluster ID, for example, even though it doesn't need to, because this way we can avoid project->map->join)

@davidchuyaya davidchuyaya requested a review from shadaj January 15, 2025 07:24
hydro_lang/src/stream.rs Outdated Show resolved Hide resolved
Copy link
Member

@shadaj shadaj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!! 🎉

@shadaj shadaj changed the title feat(hydro_lang): send_partitioned operator feat(hydro_std): send_partitioned operator and move decoupling Jan 16, 2025
@shadaj shadaj merged commit 6d77db9 into hydro-project:main Jan 16, 2025
16 checks passed
@shadaj shadaj deleted the partition_operator branch January 16, 2025 06:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants