Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[async] Emit datasets when using ExecutionMode.AIRFLOW_ASYNC #1264

Open
1 task
tatiana opened this issue Oct 21, 2024 · 0 comments
Open
1 task

[async] Emit datasets when using ExecutionMode.AIRFLOW_ASYNC #1264

tatiana opened this issue Oct 21, 2024 · 0 comments
Labels
area:datasets Related to the Airflow datasets feature/module execution:async Related to the Async execution mode
Milestone
Cosmos 1.9.0

Comments

@tatiana
Copy link
Collaborator

tatiana commented Oct 21, 2024

Context

As of Cosmos 1.7, we introduced ExecutionMode.AIRFLOW_ASYNC. However, when using this mode, users are not benefiting from Cosmos automatic Airflow dataset emission.

Acceptance criteria

  • When using ExecutionMode.AIRFLOW_ASYNC with BQ, Cosmos should emit Datasets the same way it does when using ExecutionMode.LOCAL
@tatiana tatiana added the execution:async Related to the Async execution mode label Oct 21, 2024
@dosubot dosubot bot added the area:datasets Related to the Airflow datasets feature/module label Oct 21, 2024
@tatiana tatiana mentioned this issue Oct 21, 2024
Merged
2 tasks
@tatiana tatiana added this to the Cosmos 1.9.0 milestone Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area:datasets Related to the Airflow datasets feature/module execution:async Related to the Async execution mode
Projects
None yet
Milestone
Cosmos 1.9.0
Development

No branches or pull requests
1 participant
@tatiana