Bulk Insert takes 4x as long on first operation of the day

Posted by patrick on Stack Overflow See other posts from Stack Overflow or by patrick
Published on 2010-03-23T17:27:08Z Indexed on 2010/03/23 17:33 UTC
Read the original article Hit count: 375

Filed under:

sql-server-2005

|

bulkinsert

I do Bulk Inserts into a table with about 14 million rows at fiver minute increments during a 7 hour period during the day. These inserts take somewhere between 9-14 secs. However, the first insert always takes about 40 secs. Anyone know what SQL Server 2005 would be doing differently on the first insert into a table for that day?

From what I've read I should probably use the SqlBulkCopy class instead of just using a bulk insert in a stored procedure. Is that that the general consensus?

© Stack Overflow or respective owner

Related posts about sql-server-2005

[MAJ] SQL Server 2005 Express Edition - La version gratuite de SQL Server 2005

as seen on ASP-PHP.net - Search for 'ASP-PHP.net'
Modification technique pour le site de l'article. >>> More
SQLAuthority News – Feature Pack for Microsoft SQL Server 2005 SP4

as seen on SQL Authority - Search for 'SQL Authority'
If you are still using SQL Server 2005 – I suggest that you consider migrating to later version of the SQL Server 2008/2008 R2. Due to any reason, you wanted to continue using SQL Server 2005, I suggest that you take a look at the Feature Pack for Microsoft SQL Server 2005 SP4. There are many… >>> More
SQL Server 2005 - Syncing development/production databases

as seen on Stack Overflow - Search for 'Stack Overflow'
I've got a rather large SQL Server 2005 database that is under constant development. Every so often, I either get a new developer or need to deploy wide-scale schema changes to the production server. My main concern is deploying schema + data updates to developer machines from the "master" development… >>> More
Displaying the Row Number in a SELECT Query with SQL Server 2005

as seen on Internet.com - Search for 'Internet.com'
SQL Server 2005 introduced a function that is very handy when you want the result set to have row numbers assigned to each returned row. >>> More
Displaying the Row Number in a SELECT Query with SQL Server 2005

as seen on Internet.com - Search for 'Internet.com'
SQL Server 2005 introduced a function that is very handy when you want the result set to have row numbers assigned to each returned row. >>> More

Related posts about bulkinsert

Bulkinsert from CSV into db (C#) -> max number of rows in a web application?

as seen on Stack Overflow - Search for 'Stack Overflow'
Web application - C#, .Net, SQL 2k5. I recently used bulkinsert on an other application and I thought I would like to give it a try. I am going to receive a CSV file with 1000 rows, which will most likely add 500 000 (that is five hundred thousand) records in the database. I don't have any idea yet… >>> More
How to compare two TXT files before send it to SQL

as seen on Stack Overflow - Search for 'Stack Overflow'
I have to handle TXT dat files which coming from one embed device, My problem is in that device always sending all captured data but I want to take only difrences between two sending and do calculation on them. After calculation I send it to SQL using bulkinsert function. I want to extract data… >>> More
bulk insert and update with ADO.NET Entity Framework

as seen on Stack Overflow - Search for 'Stack Overflow'
I am writing a small application that does a lot of feed processing. I want to use LINQ EF for this as speed is not an issue, it is a single user app and, in the end, will only be used once a month. My questions revolves around the best way to do bulk inserts using LINQ EF. After parsing the incoming… >>> More
SQL Server 2005: Improving performance for thousands or Insert requests. logout-login time= 120ms.

as seen on Stack Overflow - Search for 'Stack Overflow'
Can somebody shed some lights on how SQL Server 2005 deals with may request issued by a client using ADO.NET 2.0. Below is the shortend output of SQL Trace. I can see that connection pooling is working (I believe there is only one connection being pooled). What is not clear to me is why we have so… >>> More
How to bulk insert a CSV file into SQLite C#

as seen on Stack Overflow - Search for 'Stack Overflow'
I have seen similar questions (1, 2), but none of them discuss how to insert CSV files into SQLite. About the only thing I could think of doing is to use a CSVDataAdapter and fill the SQLiteDataSet, then use the SQLiteDataSet to update the tables in the database: The only DataAdapter for CSV files… >>> More