Python multithreading not working on VPS server

Posted by Sabirul Mostofa on Server Fault See other posts from Server Fault or by Sabirul Mostofa
Published on 2012-09-01T14:22:46Z Indexed on 2012/09/01 15:39 UTC
Read the original article Hit count: 308

I am running an python multithreaded application with multiple processes which scrapes data from some websites. While running on my localhost It works great, but on the vps server I am using( Centos 5.8, 2.6 GHZ with 4 cores) performs very slow.

From the nethogs command I get the network usage too low. I get around 8KBps with 15 threads. On other hand, in my PC I get the usage around 100-120KBPS.

I have read about the Python GIL and threading limitations. It seems GIL never releases the lock on the VPS though it should while doing I/0

Is there any configuration in the VPS that I need to change for the threading to work properly?

© Server Fault or respective owner

Related posts about vps

Related posts about centos5