Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Exporter] Improve exporting of databricks_pipeline resources #4142

Merged
merged 1 commit into from
Oct 24, 2024

Commits on Oct 23, 2024

  1. [Exporter] Improve exporting of databricks_pipeline resources

    Changes include:
    
    - Use `List` + iterator instead of waiting for full list - improves performance in big
      workspaces with a lot of DLT pipelines
    - Better handling of pipelines deployed via DABs - fix error that lead to emitting of
      notebooks even for DLT pipelines deployed with DABs.
    - Emit `databricks_schema` for pipelines with direct publishing mode enabled.
    alexott committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    d0b29ad View commit details
    Browse the repository at this point in the history