How to process database writes asynchronously (maybe with a message queue) from Django?

Posted by Continuation on Stack Overflow See other posts from Stack Overflow or by Continuation
Published on 2010-05-08T05:36:23Z Indexed on 2010/05/08 5:38 UTC
Read the original article Hit count: 194

Filed under:

django

|

asynchronous

|

message-queue

|

database

|

error-handling

After a user submitted data to my app, I'd like to write to the database asynchronously, possibly through a message queue.

How do I set up such a system? Are there any pluggable Django apps that do such message queue-based database writes?

Also how do i handle errors that happens during the async processing?

Would really appreciate any pointers you can give me. Thank you.

© Stack Overflow or respective owner

Related posts about django

Overriding the save() method of a model that uses django-mptt

as seen on Stack Overflow - Search for 'Stack Overflow'
I've been using django-mptt in my project for a while now, it's fabulous. Recently, I've found a need to override a model's save() method that uses mptt, and I'm getting an error when I try to save a new instance of that model: Exception Type: ValueError at /admin/scrivener/page/add/ Exception Value:… >>> More
Where is meta.local_fields set in django.db.models.base.py ?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'm getting the error: Exception Value: (1110, "Column 'about' specified twice") As I was reviewing the Django error page, I noticed that the customizations the model User, seem to be appended to the List twice. This seems to be happening here in django/db/model/base.py in base_save(): values… >>> More
Deploying Django on EC2 using Bitnami Djangostack: WSGI script cannot be loadded

as seen on Stack Overflow - Search for 'Stack Overflow'
I've been struggling to deploy Django application on Amazon EC2 using Bitnami Djangostack for the last couple of days. When I go to http://dewey.io I see the default bitnami page (/opt/bitnami/apache2/htdocs/index.html), however, when I open http://dewey.io/portnoy, I get 'Internal Server Error'… >>> More
Internal Server Error with mod_wsgi [django] on windows xp

as seen on Stack Overflow - Search for 'Stack Overflow'
when i run development server it works very well, even an empty project runing in mod_wsgi i have no problem but when i want to put my own project i get an Internal Server Error (500) in my apache conf i put WSGIScriptAlias /codevents C:/django/apache/CODEvents.wsgi <Directory "C:/django/apache"> Order… >>> More
Internal Server Error with mod_wgsi [django] on windows xp

as seen on Stack Overflow - Search for 'Stack Overflow'
when i run development server it works very well, even an empty project runing in mod_wsgi i have no problem but when i want to put my own project i get an Internal Server Error (500) in my apache conf i put WSGIScriptAlias /codevents C:/django/apache/CODEvents.wsgi <Directory "C:/django/apache"> Order… >>> More

Related posts about asynchronous

What is asynchronous image downloading?

as seen on Stack Overflow - Search for 'Stack Overflow'
I have too many images to be download from net into iPhone? How can I build an application using asynchronous image downloading?. >>> More
Asynchronous PHP request (not AJAX)

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi I am developing an eshop application. I am using webservice to create Order in Oracle database and websvc will give a response (OrderNumber) and I will inform customer that his Order (OrderNumber) is generated My problem The creation of order is taking too much time in backend system and user is… >>> More
Asynchronous operations performance

as seen on Stack Overflow - Search for 'Stack Overflow'
One of the features of asynchronous programming in .NET is saving threads during long running operation execution. The FileStream class can be setup to allow asynchronous operations, that allows running (e.g.) a copy operation without virtually using any threads. To my surprise, I found that running… >>> More
Calling Web Service Functions Asynchronously from a Web Page

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
Over on the Asp.Net forums where I moderate, a user had a problem calling a Web Service from a web page asynchronously. I tried his code on my machine and was able to reproduce the problem. I was able to solve his problem, but only after taking the long scenic route through some of the more perplexing… >>> More
C# 5 Async, Part 1: Simplifying Asynchrony – That for which we await

as seen on Reed Copsey - Search for 'Reed Copsey'
Today’s announcement at PDC of the future directions C# is taking excite me greatly. The new Visual Studio Async CTP is amazing. Asynchronous code – code which frustrates and demoralizes even the most advanced of developers, is taking a huge leap forward in terms of usability. This… >>> More