| task_key |
String |
A unique name for the task. This field is used to refer to this task from other tasks. This field is required and must be unique within its parent job. On Update or Reset, this field is used to reference the tasks to be updated or reset. The maximum length is 100 characters. |
|
| description |
Option<String> |
An optional description for this task. The maximum length is 4096 bytes. |
[optional] |
| depends_on |
Option<Veccrate::models::TaskDependenciesInner> |
An optional array of objects specifying the dependency graph of the task. All tasks specified in this field must complete successfully before executing this task. The key is task_key, and the value is the name assigned to the dependent task. This field is required when a job consists of more than one task. |
[optional] |
| existing_cluster_id |
Option<String> |
If existing_cluster_id, the ID of an existing cluster that is used for all runs of this task. When running tasks on an existing cluster, you may need to manually restart the cluster if it stops responding. We suggest running jobs on new clusters for greater reliability. |
[optional] |
| new_cluster |
Option<crate::models::NewTaskCluster> |
|
[optional] |
| job_cluster_key |
Option<String> |
If job_cluster_key, this task is executed reusing the cluster specified in job.settings.job_clusters. |
[optional] |
| notebook_task |
Option<crate::models::NotebookTask> |
|
[optional] |
| spark_jar_task |
Option<crate::models::SparkJarTask> |
|
[optional] |
| spark_python_task |
Option<crate::models::SparkPythonTask> |
|
[optional] |
| spark_submit_task |
Option<crate::models::TaskSparkSubmitTask> |
|
[optional] |
| pipeline_task |
Option<crate::models::PipelineTask> |
|
[optional] |
| python_wheel_task |
Option<crate::models::PythonWheelTask> |
|
[optional] |
| sql_task |
Option<crate::models::SqlTask> |
|
[optional] |
| dbt_task |
Option<crate::models::DbtTask> |
|
[optional] |
| libraries |
Option<Veccrate::models::Library> |
An optional list of libraries to be installed on the cluster that executes the task. The default value is an empty list. |
[optional] |
| email_notifications |
Option<crate::models::JobEmailNotifications> |
|
[optional] |
| timeout_seconds |
Option<i32> |
An optional timeout applied to each run of this job task. The default behavior is to have no timeout. |
[optional] |
| max_retries |
Option<i32> |
An optional maximum number of times to retry an unsuccessful run. A run is considered to be unsuccessful if it completes with the FAILED result_state or INTERNAL_ERROR life_cycle_state. The value -1 means to retry indefinitely and the value 0 means to never retry. The default behavior is to never retry. |
[optional] |
| min_retry_interval_millis |
Option<i32> |
An optional minimal interval in milliseconds between the start of the failed run and the subsequent retry run. The default behavior is that unsuccessful runs are immediately retried. |
[optional] |
| retry_on_timeout |
Option<bool> |
An optional policy to specify whether to retry a task when it times out. The default behavior is to not retry on timeout. |
[optional] |