How to handle added input data colums without having to maintain multiple versions of SSIS packages?

Posted by GLFelger on Stack Overflow See other posts from Stack Overflow or by GLFelger
Published on 2010-04-02T14:51:52Z Indexed on 2010/04/02 14:53 UTC
Read the original article Hit count: 161

Filed under:

ssis

|

versions

|

BI

I’m writing to solicit ideas for a solution to an upcoming problem.

The product that provides data to our ETL process currently has multiple versions. Our clients are all using some version of the product, but not all use the same version and they will not all be upgraded at the same time.

As new versions of the product are rolled out, the most common change is to add new data columns. Columns being dropped or renamed may happen occasionally, but our main focus right now is how to handle new columns being added.

The problem that we want to address is how to handle the data for clients who use an older version of the product. If we don’t account for the new columns in our SSIS packages, then the data in those columns for clients using an older product version will not be processed.

What we want to avoid is having to maintain a separate version of the SSIS packages for each version of the product. Has anyone successfully implemented a solution for this situation?

© Stack Overflow or respective owner

Related posts about ssis

SSIS packages incompatibilities between SSIS 2008 and SSIS 2008 R2

as seen on SQL Blog - Search for 'SQL Blog'
When you install SQL 2008 R2 workstation components you get a newer version of BIDS (BI Developer Studio, included in the workstation components) that replaces BIDS 2008 version (BIDS 2005 still live side-by-side). Everything would be good if you can use the newer version to edit any 2008 AND 2008R2… >>> More
Parsing flat files using SSIS : SSIS Nugget

as seen on SQL Blog - Search for 'SQL Blog'
Often when using SQL Server Integration Services (SSIS) you will find there is more than one way of accomplishing a task and that the most obvious method of doing so might not be the optimal one. In the video below I demonstrate this by way of an experiment using SSIS’s Flat File Source component;… >>> More
Introducing SSIS Reporting Pack for SQL Server code-named Denali

as seen on SQL Blog - Search for 'SQL Blog'
In recent blog posts I have introduced the new SSIS Catalog that is forthcoming in SQL Server Code-named Denali: What's new in SSIS in Denali Introduction to SSIS Projects in Denali Parameters in SSIS In Denali SSIS Server, Catalogs, Environments and Environment Variables in SSIS in Denali… >>> More
New SSIS tool on Codeplex – SSIS Log Analyzer

as seen on SQLIS - Search for 'SQLIS'
I stumbled across a new SSIS tool on Codeplex today, the SSIS Log Analyzer which was only released a few days ago. Whilst it is a beta release and currently only supports 2005 (2008 is promised) it looks quite interesting. It seems to be a fancy log viewer, but with some clever features and a nice… >>> More
New SSIS tool on Codeplex – SSIS Log Analyzer

as seen on SQLIS - Search for 'SQLIS'
I stumbled across a new SSIS tool on Codeplex today, the SSIS Log Analyzer which was only released a few days ago. Whilst it is a beta release and currently only supports 2005 (2008 is promised) it looks quite interesting. It seems to be a fancy log viewer, but with some clever features and a nice… >>> More

Related posts about versions

Are libc versions tied to kernel versions?

as seen on Ask Ubuntu - Search for 'Ask Ubuntu'
After reading the answers to my previous question I have come to the conclusion that an answer to the following question is what I was actually looking for: Does a particular version of the kernel require a particular version of libc to run properly? Basically my problem stems from building an… >>> More
Apps crashing with EXC_BAD_ACCESS when changing to a custom keyboard layout

as seen on Super User - Search for 'Super User'
I have a custom layout installed (svdvorak_mac6.keylayout). After a reboot another keyboard layout was selected, so I selected my usual one instead. This lead to a lot of apps suddenly starting to crash (Chrome, Skype, Adium etc). I can change to any other built in layout for OS X, but as soon as… >>> More
EXC_BAD_ACCESS and KERN_INVALID_ADDRESS after intiating a print sequence.

as seen on Stack Overflow - Search for 'Stack Overflow'
MAC G4/1.5GHz/2GB/1TB+ OS10.4.11 Start up Volume has been erased/complete reinstall with updated software. Current problem only occurs when printing to an Epson Artisan 800 [USB as well as Ethernet connected] when using Macromedia FreeHand 10.0.1.67. All other apps/printers work fine. Memory has been… >>> More
How do I add older versions of code into a Subversion repository as tagged versions

as seen on Stack Overflow - Search for 'Stack Overflow'
When we finally started using source control, old versions of code were added into the SVN in their own discrete folders, so I ended up with root \libv4 \libv4.2 \lib4.3 \lib5 What I would like to get to is having these older versions of the code as tagged versions inside the repository, like… >>> More
Fallback on older API versions to allow limited functionality on older OS versions

as seen on Stack Overflow - Search for 'Stack Overflow'
I am considering to use a function that was introduced in an iPhone OS version (say 4.0), but I may still want to support devices with older versions and just disable that function. What would be the best practice for doing this? Is it even allowed? >>> More