Dependency jobs can be used to launch jobs in a sequential order depending on the completion of a previous job. This kind of job can be set up by creating a shell script that calls different Slurm job scripts. The example code below is a three job dependency job that transfers data, processes the data, and then cleans up a directory.

#!/bin/bash
  
#    Submit data transfer job and give ID to transferJob variable. 
#    The cut command is for trimming down stdout to just give the job ID.
transferJob=$(sbatch run_transferData.sbatch | cut -d ' ' -f 4)

#    Run the data processing script after the data transfer job is completed.
processJob=$(sbatch  --dependency=afterok:"$transferJob" run_processData.sbatch | cut -d ' ' -f 4)

#    Run the cleanup job after the data processing job is complete.
sbatch --dependency=afterok:"$processJob" run_cleanupData.sbatch

Once you have the script written, you can execute it in the terminal by running the code found below. If you are using the web interface, you can create a job in Open Composer that runs the code below in its own job with minimal resources.

./dependencyScriptNameHere.sh