Export large amount of data from Oracle 10G to SQL Server 2005

Posted by uniball on Stack Overflow See other posts from Stack Overflow or by uniball
Published on 2010-06-10T20:18:36Z Indexed on 2010/06/10 20:23 UTC
Read the original article Hit count: 238

Dear all,

I need to export 100 million data rows (avg row length ~ 100 bytes) from Oracle 10G database table into SQL server (over WAN/VLAN with 6MBits/sec capacity) on a regular basis. So far, these are the options that I have tried and a quick summary. Has anyone tried this before? Are there other better options? Which option would be the best in terms of performance and reliability? The time taken has been calculated using tests on smaller amounts of data and then extrapolating it to estimate the time required.

  1. Using data import wizard on the SQL server or SSIS packages to import the data. It will take around 150 hours to complete the task.
  2. Using Oracle batch job to spool data into a comma-delimited flat-file. Then using SSIS package to FTP this file to the SQL server and then load directly from the flat-file. The issue here is the size of the flat-file which is expected to run in GBs.
  3. Although this option is drastically different, I am even considering the option of using Linked Server to query the Oracle data directly at run-time to avoid bringing in data. Performance is a big problem and I have limited control over the Oracle database in terms of creating table indexes.

Regards,

Uniball

© Stack Overflow or respective owner

Related posts about sql

Related posts about sql-server-2005