RabbitMQ as a proxy between a data store and a producer ?

Posted by hyperboreean on Stack Overflow See other posts from Stack Overflow or by hyperboreean
Published on 2010-05-26T15:54:29Z Indexed on 2010/05/26 22:01 UTC
Read the original article Hit count: 144

Filed under:

rabbitmq

I have some code that produces lots of data that should be stored in the database. The problem is that the database can't keep with the data that it gets produced. So I am wondering whether some kind of queuing mechanism would help in this situation - I am thinking in particular at RabiitMQ and whether is feasible to have the data stored in its queues until some consumer gets the data out of it and pushes it to the database. Also, I am not particular interested whether that data made it to the database or not because pretty soon, the same data will be updated.

Related posts about rabbitmq

Unable to start rabbitmq-server on Ubuntu 12.04

as seen on Server Fault - Search for 'Server Fault'
I try to install rabbitmq-server on ubuntu-server 12.04 but failed. Then I add the apt source list following the guide in http://www.rabbitmq.com/install-debian.html But reinstall still have the same error as following: $ sudo aptitude install rabbitmq-server ... Setting up rabbitmq-server (2.8… >>> More
Veewee, Vagrant, Puppet, Erlang and RabbitMQ

as seen on Server Fault - Search for 'Server Fault'
I am kinda stuck with a problem I am trying to wrap my head around for days now. Here is what I am doing: By using Veewee, I am creating a VirtualBox image and then I create a Vagrant box from it. See here, here Finally I run puppet from Vagrant to install RabbitMQ, see here. Veewee, Vagrant… >>> More
RabbitMQ and persistence (blocking writes?)

as seen on Server Fault - Search for 'Server Fault'
I want to create a RabbitMQ server on a virtual machine (VMware) to be used in production. It will contain persistent queues. I'm wondering if it is a bad idea to store the server on a NAS that's accessed over NFS. Basically my questions are: Will RabbitMQ's writes be blocking? Will the entire… >>> More
php amqp error while running make

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I'm trying to install php amqp according to this answer http://stackoverflow.com/a/9997263/2271028 but at the make command i see following: /bin/bash /var/www/rabbitmq-c/amqp-1.4.0/libtool --mode=compile cc -I. -I/var/www/rabbitmq-c/amqp-1.4.0 -DPHP_ATOM_INC -I/var/www/rabbitmq-c/amqp-1.4.0/include… >>> More
Does RabbitMq do round-robin from the exchange to the queues

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I am currently evaluating message queue systems and RabbitMq seems like a good candidate, so I'm digging a little more into it. To give a little context I'm looking to have something like one exchange load balancing the message publishing to multiple queues. I don't want to replicate the messages… >>> More

Developer IT