10

Say I want to run a job on the cluster: job1.m

Slurm handles the batch jobs and I'm loading Mathematica to save the output file job1.csv

I submit job1.m and it is sitting in the queue. Now, I edit job1.m to have different variables and parameters, and tell it to save data to job1_edited.csv. Then I re-submit job1.m.

Now I have two batch jobs in the queue.

What will happen to my output files? Will job1.csv be data from the original job1.m file? And will job1_edited.csv be data from the edited file? Or will job1.csv and job1_edited.csv be the same output?

:(

Thanks in advance!

Aacini
  • 65,180
  • 12
  • 72
  • 108
Alyssa
  • 101
  • 1
  • 3
  • Note that the `batch-file` tag is used for something completelly different and not related to your question. I changed such tag by `batch-processing` one. – Aacini Aug 26 '15 at 03:29
  • why don't you test this? Use a debug queue, and submit a print statement "original jobfile", then change it to "modified jobfile" and submit. – anon01 Aug 26 '15 at 03:32

1 Answers1

12

I am assuming job1.m is a Mathematica job, run from inside a Bash submission script. In that case, job1.m is read when the job starts so if it is modified after submission but before job start, the modified version will run. If it is modified after the job starts, the original version will run.

If job1.m is the submission script itself (so you run sbatch job1.m), that script is copied in a spool directory specific to the job so if it is modified after the job is submitted, it still will run the original version.

In any case, it is better, for reproducibility and traceability, to make use of a workflow manager such as Fireworks, or Bosco

damienfrancois
  • 52,978
  • 9
  • 96
  • 110