Queue remote calls to a Python Twisted perspective broker?
Posted
by agartland
on Stack Overflow
See other posts from Stack Overflow
or by agartland
Published on 2010-05-18T23:22:21Z
Indexed on
2010/05/19
2:20 UTC
Read the original article
Hit count: 234
The strength of Twisted (for python) is its asynchronous framework (I think). I've written an image processing server that takes requests via Perspective Broker. It works great as long as I feed it less than a couple hundred images at a time. However, sometimes it gets spiked with hundreds of images at virtually the same time. Because it tries to process them all concurrently the server crashes.
As a solution I'd like to queue up the remote_calls on the server so that it only processes ~100 images at a time. It seems like this might be something that Twisted already does, but I can't seem to find it. Any ideas on how to start implementing this? A point in the right direction? Thanks!
© Stack Overflow or respective owner