Plugin DatabricksJob

SubmitRun ​Submit​Run

yaml
type: "io.kestra.plugin.databricks.job.submitrun"
yaml
id: databricks_job_submit_run
namespace: company.team

tasks:
  - id: submit_run
    type: io.kestra.plugin.databricks.job.SubmitRun
    host: "{{ secret('DATABRICKS_HOST') }}"
    authentication:
      token: "{{ secret('DATABRICKS_TOKEN') }}"
    runTasks:
      - existingClusterId: <your-cluster>
        taskKey: pysparkTask
        sparkPythonTask:
          pythonFile: /Shared/hello.py
          sparkPythonTaskSource: WORKSPACE
    waitForCompletion: PT5M
Properties
Min items 1
Format duration
Format uri
SubType string
Possible Values
GITWORKSPACE
SubType string
SubType string
Possible Values
GITWORKSPACE
SubType string