Code

[FEATURE] 163 - For each task#185

Code

Merged

asingamaneni merged 30 commits intoNike-Inc:mainNike-Inc/brickflow:mainfrom riccamini:feature/163-for-each-task-supportriccamini/brickflow:feature/163-for-each-task-supportCopy head branch name to clipboardDec 18, 2024

+2,877-1,814

Commits

Commits on Dec 2, 2024

• Support for foreach task

  riccamini

  committed
  09bf43e

  Copy full SHA for 09bf43e

Commits on Dec 3, 2024

• tests

  riccamini

  committed
  8e7c423

  Copy full SHA for 8e7c423

• refactor: DatabricksBundleCodegen to improve task handling and streamline workflow task generation

  mikita-sakalouski

  committed
  cb39e5e

  Copy full SHA for cb39e5e

• fix: update task builder function to use nested task type for improved accuracy

  mikita-sakalouski

  committed
  8d99954

  Copy full SHA for 8d99954

• Merge pull request #1 from riccamini/feature/mikita_contribution

  Show description for aaf1578
  riccamini

  authored
  aaf1578

  Copy full SHA for aaf1578

Commits on Dec 4, 2024

• Builders in _get_task_builder can be resolved also from task class

  riccamini

  committed
  afbd444

  Copy full SHA for afbd444

Commits on Dec 5, 2024

• Fix tests and serialization issue with ForEachTask custom class

  riccamini

  committed
  953f79c

  Copy full SHA for 953f79c

Commits on Dec 6, 2024

• Support for brickflow task type in for each task

  riccamini

  committed
  0285f59

  Copy full SHA for 0285f59

Commits on Dec 9, 2024

• Setting push_return_value in task response to False if task type is for each task

  riccamini

  committed
  197e868

  Copy full SHA for 197e868

• Refactoring for each task build function to allow for validation of task type also in case of nested task being of Brickflow type

  riccamini

  committed
  b46bd32

  Copy full SHA for b46bd32

Commits on Dec 10, 2024

• Support for spark jar task type in for each task

  riccamini

  committed
  a688ce1

  Copy full SHA for a688ce1

Commits on Dec 12, 2024

• Tests for run job task type in for each task

  riccamini

  committed
  ebb12b1

  Copy full SHA for ebb12b1

• Tests for sql task type in for each task

  riccamini

  committed
  de85a5a

  Copy full SHA for de85a5a

Commits on Dec 16, 2024

• feat: add JobsTasksForEachTaskConfigs for improved task configuration and validation

  mikita-sakalouski

  committed
  4dba431

  Copy full SHA for 4dba431

• Merge remote-tracking branch 'origin/feature/163-for-each-task-support' into feature/for_each_model_settings

  mikita-sakalouski

  committed
  2acaa85

  Copy full SHA for 2acaa85

• feat: add JobsTasksForEachTaskConfigs for for-each task configuration and validation

  mikita-sakalouski

  committed
  a80d229

  Copy full SHA for a80d229

• feat: implement model validation for ForEachTask configuration inputs and concurrency

  mikita-sakalouski

  committed
  5a67000

  Copy full SHA for 5a67000

• feat: simplify ForEachTask initialization by using task configuration object

  mikita-sakalouski

  committed
  dbf98e0

  Copy full SHA for dbf98e0

• fix format

  mikita-sakalouski

  committed
  aa2420b

  Copy full SHA for aa2420b

• fix format

  mikita-sakalouski

  committed
  d51ce57

  Copy full SHA for d51ce57

• Removed TODO, nested task name is not exposed

  riccamini

  committed
  4421ee9

  Copy full SHA for 4421ee9

• Documentation of for each task type

  riccamini

  committed
  a1b8ff9

  Copy full SHA for a1b8ff9

• For each task examples

  riccamini

  committed
  7deec96

  Copy full SHA for 7deec96

• Merge pull request #2 from riccamini/feature/for_each_model_settings

  Show description for abbf90b
  riccamini

  authored
  abbf90b

  Copy full SHA for abbf90b

• Moved for each task config validation up

  riccamini

  committed
  4ff9c13

  Copy full SHA for 4ff9c13

• Updates to doc and examples after introduction of for each task config model

  riccamini

  committed
  b9131f2

  Copy full SHA for b9131f2

Commits on Dec 17, 2024

• chore: update Python version to 3.9 and refine configuration files

  mikita-sakalouski

  committed
  b2b915e

  Copy full SHA for b2b915e

• chore: update documentation dependencies and versions in pyproject.toml

  mikita-sakalouski

  committed
  c5b495c

  Copy full SHA for c5b495c

Commits on Dec 18, 2024

• Fixed formatting of bullet points in doc

  riccamini

  committed
  d5c25b9

  Copy full SHA for d5c25b9

• Update brickflow project conf in for each examples

  riccamini

  committed
  23c86a1

  Copy full SHA for 23c86a1