Problem with a large CSV file
- by moustafa
I have a very large CSV file. 51427 lines to be exact.
I need to import the entire file into a MySQL database, however, the script times out due to server settings and slow connection (and maybe other reasons that I am not aware of).
So - I am now passing parameters START and LIMIT via address bar to import, like this:
http://my.server.address/import.php?...000&limit=1000
This reads the entire CSV file into an array, and starts at line 10000 of the array and inserts into the database until it reaches line 11000, and then terminates the script.
This works very nicely, however, I am not happy having to reach the entire 51427 lines of the CSV file into an array before processing.
Is there not a way where I can only read the required lines into an array? That would speed things up significantly.