Releases: Nike-Inc/brickflow
Releases · Nike-Inc/brickflow
v0.11.0
What's Changed
- Pydantic 2.4 support by @dannymeijer in #59
- updating contributors by @asingamaneni in #62
- updated the model to the latest version of the bundles cli (0.210.2) and update… by @stikkireddy in #51
- adding uc to snowflake operator by @ckonuganti in #69
New Contributors
- @dannymeijer made their first contribution in #59
- @ckonuganti made their first contribution in #69
Full Changelog: v0.10.3...v0.11.0
v0.10.3
What's Changed
- Fix: Title for autosys sensor in documentation by @rebecca-rajshree in #50
- add run_if param to TaskSettings by @grigoriy835 in #53
- Add ability to set timeout health check in workflows by @brent-johnson in #58
- Fix issue 48 and 60 related to the WorkflowDependencySensor by @BrendBraeckmans in #61
New Contributors
- @grigoriy835 made their first contribution in #53
- @brent-johnson made their first contribution in #58
Full Changelog: v0.10.2...v0.10.3
v0.10.2
What's Changed
- Updated TaskDependency Sensor to account for execution delta and enabled logging for debugging purposes by @bsangars in #38
- updating contributors and read me by @asingamaneni in #41
- Feature support job schedule pause status by @asingamaneni in #42
- Autosys Sensor by @rebecca-rajshree in #33
- Make node_type_id optional as it's otherwise impossible to create a cluster from resources in a pool by @BrendBraeckmans in #44
New Contributors
- @bsangars made their first contribution in #38
- @rebecca-rajshree made their first contribution in #33
- @BrendBraeckmans made their first contribution in #44
Full Changelog: v0.10.1...v0.10.2
v0.10.1
What's Changed
- made logos transparent by @jhollow in #25
- Fix/brickflow examples by @pariksheet in #36
- Addressing the issue - #34 by @asingamaneni in #37
Full Changelog: v0.10.0...v0.10.1
v0.10.0
What's Changed
- Feature remove cdktf by @asingamaneni in #18
- Adding pull request and issue templates by @asingamaneni in #19
- fix: generate the bundle path including prefix/suffix if available by @pariksheet in #20
- fixed documentation and refactored external task dependency sensor. by @stikkireddy in #21
New Contributors
- @pariksheet made their first contribution in #20
Full Changelog: v0.9.2...v0.10.0
v0.9.2
What's Changed
- Adding code cov and github badges by @asingamaneni in #13
- Fix/brickflow version by @stikkireddy in #14
Full Changelog: v0.9.1...v0.9.2
v0.9.1
What's Changed
- Multiple changes to move package to brickflows by @asingamaneni in #11
- Updating the package name to brickflows as pypi won't accept brickflow
- Updating documentation and logo link
- Updating codeowners
- modify all code to reference brickflows by @stikkireddy in #12
Full Changelog: v0.9.0...v0.9.1
v0.9.0
What's Changed
This is the first release for brickflow, which is a tool to build Databricks workflows using python. Right now brickflow supports CDKTF(to be deprecated soon) and Databricks Asset Bundles.
- Moved the source code from Internal Nike repository to the OSS public repo contributed by @asingamaneni & @stikkireddy
- Github actions initial setup by @stikkireddy in #3
- Multiple changes by @stikkireddy in #2
- commit for multi projects and reimporting existing workflows with same name
- fixed tests and added support for notebook native tasks
- added some comments and examples of how to use parameters.
- changes to help string for project add and also resolving recursively to root from notebook context as well.
- added /Workspace root for getting notebook path
- fixed removing projects correctly from the multi-project.yml file as well
- fixed tests and added support for multiple project deployments in the same directory by making the environment names different values
- be lax with development for local development if git commit yields nothing
- added support for workflow level notifications and webhooks, task notification settings and support for photon in compute. also root, filepath and statepath will write posix paths. python binary will be fetched from entrypoint executable that is used
- fixed unnecessary code in plugins and added a feature flag for using project name as part of the env
- added synth command for projects
- added local task settings at task level and also added workflow level settings for webhooks, emails and notifications
- suffixed all the workflow level settings with Workflow due to import from brickflow making it confusing with task level objects
- make sure import manager uses the new import folder syntax structure.
- make sure imports only work with projects tagged with this brickflow project, permissive of duplicates still
- clean up logging entry points to only log when project is kicked off or cli is called.
- clear docs on resolver for imports and proper docs
- remove resolver and properly load plugins for airflow and py4j (cronhelper) integration
- made cronhelper lazy, added unit tests for plugins and added py4j as a dev dependency
- added setup for java for github actions
- automatically add the brickflow library to the cluster and flag to opt out. Run bundles cli from anywhere within the project root
- set the monorepo path variable for correct bundle paths
- updated the ascii art to be more legible
- fixed bug related to suffix and prefix not being properly populated during runtime.
- update databricks cli to 0.203.0
- fixed library handling
- update all deps
- separate airflow installation from brickflow and remove it as optional
- added deployment job to pypi and fixed issue with code coverage
- Add logos and update README.md by @jhollow in #6
- Adding github badges by @asingamaneni in #5
New Contributors
- @stikkireddy made their first contribution in #3
- @jhollow made their first contribution in #6
- @asingamaneni made their first contribution in #5
Full Changelog: https://github.com/Nike-Inc/brickflow/commits/v0.9.0