Skip to content

Releases: Nike-Inc/brickflow

v0.11.0

13 Dec 21:15
85ee1cd
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.10.3...v0.11.0

v0.10.3

13 Nov 22:43
d49ddac
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.10.2...v0.10.3

v0.10.2

02 Oct 08:13
e3245bf
Compare
Choose a tag to compare

What's Changed

  • Updated TaskDependency Sensor to account for execution delta and enabled logging for debugging purposes by @bsangars in #38
  • updating contributors and read me by @asingamaneni in #41
  • Feature support job schedule pause status by @asingamaneni in #42
  • Autosys Sensor by @rebecca-rajshree in #33
  • Make node_type_id optional as it's otherwise impossible to create a cluster from resources in a pool by @BrendBraeckmans in #44

New Contributors

Full Changelog: v0.10.1...v0.10.2

v0.10.1

09 Sep 01:21
45bd0fc
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.10.0...v0.10.1

v0.10.0

25 Aug 21:45
3c60c2c
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.9.2...v0.10.0

v0.9.2

11 Aug 02:48
4c90cd9
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.1...v0.9.2

v0.9.1

11 Aug 01:40
ca35c70
Compare
Choose a tag to compare

What's Changed

  • Multiple changes to move package to brickflows by @asingamaneni in #11
    • Updating the package name to brickflows as pypi won't accept brickflow
    • Updating documentation and logo link
    • Updating codeowners
  • modify all code to reference brickflows by @stikkireddy in #12

Full Changelog: v0.9.0...v0.9.1

v0.9.0

10 Aug 23:54
7210bbc
Compare
Choose a tag to compare

What's Changed

This is the first release for brickflow, which is a tool to build Databricks workflows using python. Right now brickflow supports CDKTF(to be deprecated soon) and Databricks Asset Bundles.

  • Moved the source code from Internal Nike repository to the OSS public repo contributed by @asingamaneni & @stikkireddy
  • Github actions initial setup by @stikkireddy in #3
  • Multiple changes by @stikkireddy in #2
    • commit for multi projects and reimporting existing workflows with same name
    • fixed tests and added support for notebook native tasks
    • added some comments and examples of how to use parameters.
    • changes to help string for project add and also resolving recursively to root from notebook context as well.
    • added /Workspace root for getting notebook path
    • fixed removing projects correctly from the multi-project.yml file as well
    • fixed tests and added support for multiple project deployments in the same directory by making the environment names different values
    • be lax with development for local development if git commit yields nothing
    • added support for workflow level notifications and webhooks, task notification settings and support for photon in compute. also root, filepath and statepath will write posix paths. python binary will be fetched from entrypoint executable that is used
    • fixed unnecessary code in plugins and added a feature flag for using project name as part of the env
    • added synth command for projects
    • added local task settings at task level and also added workflow level settings for webhooks, emails and notifications
    • suffixed all the workflow level settings with Workflow due to import from brickflow making it confusing with task level objects
    • make sure import manager uses the new import folder syntax structure.
    • make sure imports only work with projects tagged with this brickflow project, permissive of duplicates still
    • clean up logging entry points to only log when project is kicked off or cli is called.
    • clear docs on resolver for imports and proper docs
    • remove resolver and properly load plugins for airflow and py4j (cronhelper) integration
    • made cronhelper lazy, added unit tests for plugins and added py4j as a dev dependency
    • added setup for java for github actions
    • automatically add the brickflow library to the cluster and flag to opt out. Run bundles cli from anywhere within the project root
    • set the monorepo path variable for correct bundle paths
    • updated the ascii art to be more legible
    • fixed bug related to suffix and prefix not being properly populated during runtime.
    • update databricks cli to 0.203.0
    • fixed library handling
    • update all deps
    • separate airflow installation from brickflow and remove it as optional
    • added deployment job to pypi and fixed issue with code coverage
  • Add logos and update README.md by @jhollow in #6
  • Adding github badges by @asingamaneni in #5

New Contributors

Full Changelog: https://github.com/Nike-Inc/brickflow/commits/v0.9.0