Export large amount of data from Oracle 10G to SQL Server 2005
Posted
by uniball
on Stack Overflow
See other posts from Stack Overflow
or by uniball
Published on 2010-06-10T20:18:36Z
Indexed on
2010/06/10
20:23 UTC
Read the original article
Hit count: 238
Dear all,
I need to export 100 million data rows (avg row length ~ 100 bytes) from Oracle 10G database table into SQL server (over WAN/VLAN with 6MBits/sec capacity) on a regular basis. So far, these are the options that I have tried and a quick summary. Has anyone tried this before? Are there other better options? Which option would be the best in terms of performance and reliability? The time taken has been calculated using tests on smaller amounts of data and then extrapolating it to estimate the time required.
- Using data import wizard on the SQL server or SSIS packages to import the data. It will take around 150 hours to complete the task.
- Using Oracle batch job to spool data into a comma-delimited flat-file. Then using SSIS package to FTP this file to the SQL server and then load directly from the flat-file. The issue here is the size of the flat-file which is expected to run in GBs.
- Although this option is drastically different, I am even considering the option of using Linked Server to query the Oracle data directly at run-time to avoid bringing in data. Performance is a big problem and I have limited control over the Oracle database in terms of creating table indexes.
Regards,
Uniball
© Stack Overflow or respective owner