Problems opening large csv file

Posted by John Tyler on Stack Overflow See other posts from Stack Overflow or by John Tyler
Published on 2010-06-16T18:30:02Z Indexed on 2010/06/16 18:32 UTC
Read the original article Hit count: 197

Filed under:
|
|
|
|

I have a csv file that is 100mb in size. I need to parse some data out of it into a new format.

I tried PHP, but keep running into memory issues. After around the first 150 "rows" or so, the script poops out. This is even on the localhost, and doing everything I can to tune the PHP settings, including max_memory and script_execution_time.

Now before I continue, I'd like to know if Python will poop out on me too. Or if I will have to use C++.

Can someone name good csv libraries for for these programmin langueage? The file is quoted csv.

I mean scheiza I can't even open this text file in OpenOffice without it dying on me. (then again, Java sux as bad as PHP)

© Stack Overflow or respective owner

Related posts about java

Related posts about php