Start, pause multiple jobs

DataHub supports the starting and pausing of multiple jobs at once.  This feature supports filtering the full list of jobs by search criteria or starting / pausing all jobs.  The use of this feature via the REST API is described below. 

Starting multiple jobs

The syntax for starting and pausing jobs is very similar.  The filtering options outlined in the examples apply to both actions.

By default, DataHub will run 6 jobs in parallel. For example, if you start 15 jobs at once, only the first 6 will execute. The rest will be in the queue to start as the others finish

Example 1: Start all jobs

In this scenario, all DataHub jobs will be started.  

PATCH

{{url}}v1/jobs?start

Example 2: Pause all jobs

In this scenario, all DataHub jobs will be paused.

PATCH

{{url}}v1/jobs?pause

Example 3: Start jobs using search text to filter the list of jobs

In this scenario, all DataHub jobs with the word "testjob" will be started.  

PATCH

{{url}}v1/jobs?q=testjob&start

Example 4: Start jobs using an offset and limit to filter the list of jobs

In this scenario, the first five DataHub jobs after the seventh job will be started.

PATCH

{{url}}v1/jobs?offset=7&limit=5&start

Example 5: Start jobs with a specified parent job

In this scenario, all DataHub jobs with the specified parent job ID will be started.  

PATCH

{{url}}v1/jobs?parent=123&start

Related Links