Scaling a ruby script by launching multiple processes instead of using threads.

Posted by Zombies on Stack Overflow See other posts from Stack Overflow or by Zombies
Published on 2010-05-11T12:34:42Z Indexed on 2010/05/11 12:54 UTC
Read the original article Hit count: 165

Filed under:
|
|

I want to increase the throughput of a script which does net I/O (a scraper). Instead of making it multithreaded in ruby (I use the default 1.9.1 interpreter), I want to launch multiple processes. So, is there a system for doing this to where I can track when one finishes to re-launch it again so that I have X number running at any time. ALso some will run with different command args. I was thinking of writing a bash script but it sounds like a potentially bad idea if there already exists a method for doing something like this on linux.

© Stack Overflow or respective owner

Related posts about ruby

Related posts about scaling