Best Work Queue service for distributed clusters
- by onewheelgood
Hi there.
I require a simple work queue type system for asynchronous task management.
I have looked at both beanstalkd and gearman. However, both these seem to assume that the client and the queue server are on the same network, and therefore that there will always be a reliable network between them.
I need one that can support the client and server being in different places in the world, and be able to manage temporary loss of network connection between clusters.
Ideally, this would work in such a way where I post a job to a local proxy that attempts to send it to the main queue server. If there is no network connection, it would try again later, however it would not lose the job or delay the client.
Any recommendations?
