Whats wrong with this task queue setup?
Posted
by Peter Farmer
on Stack Overflow
See other posts from Stack Overflow
or by Peter Farmer
Published on 2010-05-31T07:56:01Z
Indexed on
2010/05/31
18:13 UTC
Read the original article
Hit count: 335
python
|google-app-engine
I've setup this task queue implementation on a site I host for a customer, it has a cron job
which runs each morning at 2am "/admin/tasks/queue
", this queues up emails to be sent out, "/admin/tasks/email
", and uses cursors
so as to do the queuing in small chunks. For some reason last night /admin/tasks/queue
kept getting run by this code and so sent out my whole quota of emails :/
. Have I done something wrong with this code?
class QueueUpEmail(webapp.RequestHandler):
def post(self):
subscribers = Subscriber.all()
subscribers.filter("verified =", True)
last_cursor = memcache.get('daily_email_cursor')
if last_cursor:
subscribers.with_cursor(last_cursor)
subs = subscribers.fetch(10)
logging.debug("POST - subs count = %i" % len(subs))
if len(subs) < 10:
logging.debug("POST - Less than 10 subscribers in subs")
# Subscribers left is less than 10, don't reschedule the task
for sub in subs:
task = taskqueue.Task(url='/admin/tasks/email', params={'email': sub.emailaddress, 'day': sub.day_no})
task.add("email")
memcache.delete('daily_email_cursor')
else:
logging.debug("POST - Greater than 10 subscibers left in subs - reschedule")
# Subscribers is 10 or greater, reschedule
for sub in subs:
task = taskqueue.Task(url='/admin/tasks/email', params={'email': sub.emailaddress, 'day': sub.day_no})
task.add("email")
cursor = subscribers.cursor()
memcache.set('daily_email_cursor', cursor)
task = taskqueue.Task(url="/admin/tasks/queue", params={})
task.add("queueup")
© Stack Overflow or respective owner