Performance impact: What is the optimal payload for SqlBulkCopy.WriteToServer()?

Posted by Linchi Shea on SQL Blog See other posts from SQL Blog or by Linchi Shea
Published on Fri, 01 Jul 2011 15:54:00 GMT Indexed on 2011/07/01 16:28 UTC
Read the original article Hit count: 480

Filed under:

Batch Size

|

Data Load

|

multi-threading

|

Parallelism

|

Performance

|

sqlbulkcopy

For many years, I have been using a C# program to generate the TPC-C compliant data for testing. The program relies on the SqlBulkCopy class to load the data generated by the program into the SQL Server tables. In general, the performance of this C# data loader is satisfactory. Lately however, I found myself in a situation where I needed to generate a much larger amount of data than I typically do and the data needed to be loaded within a confined time frame. So I was driven to look into the code...(read more)

© SQL Blog or respective owner

Related posts about Batch Size

Planning Database as a Service Implementation Project

as seen on Oracle Blogs - Search for 'Oracle Blogs'
People, process and planning are the three key elements to success in a private cloud journey. Some common questions i hear from field/customers often relates to tasks involved in setting up Database-as-a-Service(DBaaS) using Oracle Enterprise Manager 12c from scratch and how these tasks are mapped… >>> More
Running Java from a Windows batch file causes the batch file to stop

as seen on Super User - Search for 'Super User'
When I run Java from a Windows .cmd file (Vista 32-bit here), the Java command causes the batch file to stop executing additional commands. For example, this is a simple test.cmd file: java java This should cause Java to print its help message twice. However when I run it in cmd.exe, I get this: C:\>test C:\>java Usage:… >>> More
How to write a XSLT for this XML?

as seen on Stack Overflow - Search for 'Stack Overflow'
<?xml version="1.0" encoding="utf-8"?>  <!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd"> <svg version="1.1" xmlns="http://www.w3… >>> More
Batch break up after call other batch file

as seen on Stack Overflow - Search for 'Stack Overflow'
i have the problem, that my batch process breaking up each time after call a other batch file. The batch files are used to run a make process out from IBM Rhapsody. There convert the call from Rhapsody to the Visual Studio tools. So nmake will be called from the batch after make different settings… >>> More
Execute batch file after another batch file completes

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a batch file coordinating the activity of two other batch file. How can I make it execute the second batch file only after the first bat file finishes execution. I do not care if the first batch file executes successfully or not. >>> More

Related posts about Data Load

Unable to start sublime text

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
I had been using Sublime Text 2 with no issues. I installed IDLE and now I'm unable to start Sublime Text. I tried uninstalling IDLE, but Sublime Text is still not starting. Here's the error: Unable to load libgdk-x11-2.0.so Unable to load gdk_cairo_create from libgdk-x11-2.0.so Unable to load… >>> More
How do I add PHP support to Apache 2 without breaking my current installation?

as seen on Stack Overflow - Search for 'Stack Overflow'
I run Apache 2 with WSGI (for a Django-app) on a Ubuntu box. I want to use Nagios for server monitoring, and for this purpose it seems I have to add PHP support to Apache. When I installed Apache 2, I did this: apt-get install apache2 apache2.2-common apache2-mpm-worker apache2-threaded-dev libapache2-mod-wsgi… >>> More
timetable in a jTable

as seen on Stack Overflow - Search for 'Stack Overflow'
I want to create a timetable in a jTable. For the top row it will display from monday to sunday and the left colume will display the time of the day with 2h interval e.g 1st colume (0000 - 0200), 2nd colume (0200 - 0400) .... And if i click a button the timing will change from 2h interval to 1h interval… >>> More
Reading data from an Entity Framework data model through a WCF Data Service

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
This is going to be the fourth post of a series of posts regarding ASP.Net and the Entity Framework and how we can use Entity Framework to access our datastore. You can find the first one here , the second one here and the third one here . I have a post regarding ASP.Net and EntityDataSource. You… >>> More
SQL SERVER – Advanced Data Quality Services with Melissa Data – Azure Data Market

as seen on SQL Authority - Search for 'SQL Authority'
There has been much fanfare over the new SQL Server 2012, and especially around its new companion product Data Quality Services (DQS). Among the many new features is the addition of this integrated knowledge-driven product that enables data stewards everywhere to profile, match, and cleanse data.… >>> More