Condor job using DAG with some jobs needing to run the same host

Posted by gurney alex on Stack Overflow See other posts from Stack Overflow or by gurney alex
Published on 2010-02-26T07:09:31Z Indexed on 2010/03/09 4:51 UTC
Read the original article Hit count: 207

Filed under:
|
|

I have a computation task which is split in several individual program executions, with dependencies. I'm using Condor 7 as task scheduler (with the Vanilla Universe, due do constraints on the programs beyond my reach, so no checkpointing is involved), so DAG looks like a natural solution. However some of the programs need to run on the same host. I could not find a reference on how to do this in the Condor manuals.

Example DAG file:

JOB  A  A.condor 
JOB  B  B.condor 
JOB  C  C.condor    
JOB  D  D.condor
PARENT A CHILD B C
PARENT B C CHILD D

I need to express that B and D need to be run on the same computer node, without breaking the parallel execution of B and C.

Thanks for your help.

© Stack Overflow or respective owner

Related posts about distributed

Related posts about hpc