[Repronim-trd3] no meetup today - let's just work

[Haselgrove, Christian]

Kyle wrote:

Ah, sorry for not addressing that with my previous reply.  The number of
subjobs is determined by run's --batch-parameter/--batch-spec.  These
are used in orchestrators.py to construct the _command_array item of the
job spec.  The length of this array is taken as the number of subjobs:

   def submit(self):
       """Submit the job with `submitter`.
       """
       njobs = len(self.job_spec["_command_array"])
       [...]

That value gets injected into the submission template to control the
number of subjobs.  So, to use condor as an example: with a command
array with 4 items, this bit of the condor.template

   arguments = "$(Process)"
   queue {{ _num_subjobs }}

gets expanded into

   arguments = "$(Process)"
   queue 4

Submitting that leads to condor executing

   [...]/runscript 1
   [...]/runscript 2
   [...]/runscript 3
   [...]/runscript 4

Got it; thanks.

c

--
Christian Haselgrove
christian.haselgrove at umassmed.edu<mailto:christian.haselgrove at umassmed.edu>
774-455-4109

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.nitrc.org/pipermail/repronim-trd3/attachments/20201008/6f468c80/attachment.html>