Python multithreading not working on VPS server
Posted
by
Sabirul Mostofa
on Server Fault
See other posts from Server Fault
or by Sabirul Mostofa
Published on 2012-09-01T14:22:46Z
Indexed on
2012/09/01
15:39 UTC
Read the original article
Hit count: 308
I am running an python multithreaded application with multiple processes which scrapes data from some websites. While running on my localhost It works great, but on the vps server I am using( Centos 5.8, 2.6 GHZ with 4 cores) performs very slow.
From the nethogs command I get the network usage too low. I get around 8KBps with 15 threads. On other hand, in my PC I get the usage around 100-120KBPS.
I have read about the Python GIL and threading limitations. It seems GIL never releases the lock on the VPS though it should while doing I/0
Is there any configuration in the VPS that I need to change for the threading to work properly?
© Server Fault or respective owner