Is there a way to configure timeout for speculative execution in Hadoop?

Posted by S.O. on Stack Overflow See other posts from Stack Overflow or by S.O.
Published on 2010-06-14T19:49:01Z Indexed on 2010/06/14 19:52 UTC
Read the original article Hit count: 275

Filed under:
|

I have hadoop job with tasks that are expected to run for significant length of fime (few minues). However hadoop starts speculative execution too soon. I do not want to turn speculative execution completely off but I want to increase duration of time hadoop waits before considering job for speculative execution. Is there a config option to control this timeout?

Thanks

© Stack Overflow or respective owner

Related posts about hadoop

Related posts about mapreduce