Welcome to EMC Consulting Blogs Sign in | Join | Help

SSIS Junkie

Normaliser Component v2 : SSIS

About 18 months ago I made available a custom SSIS component called the “Normaliser Component” which I’d been intending to upgrade for use with SSIS2008 but had not yet gotten around to doing. Earlier this week I got an email from someone asking me if I was going to make such a version available so I was spurred into doing the upgrade.

First a reminder about what it does. The Normaliser component takes a denormalised, sorted dataset as input and produces two outputs; firstly a distinct set of the sorted columns with a unique identifier for each (aka the ‘master’ dataset) and secondly a set containing all the unsorted columns with a pointer back to the unique identifier of the sorted columns (aka the ‘detail’ dataset).

Its easier to illustrate with pictures than words. Basically it takes the following input which is sorted on {OrderID, CustomerName}:

image and produces the following two outputs:

image                                     image

 

Here’s how the Normaliser Component looks on the design surface:

image

As I said above I have now compiled a version that works with SSIS 2008 and you can download the installer from Codeplex from where you can also get the source code.

Hope this proves useful. If you have any questions please put them in the comments section below.

-Jamie

Published Thursday, April 23, 2009 12:31 PM by jamie.thomson

Comments

 

Dew Drop - April 24, 2009 | Alvin Ashcraft's Morning Dew said:

April 24, 2009 2:28 PM
 

Dew Drop - April 24, 2009 | Alvin Ashcraft's Morning Dew said:

April 24, 2009 2:28 PM
 

ranomore said:

Jamie -- this is going to sound stupid, but would you add a screenshot of the component in context of the dataflow? Or maybe one of the sort component that points out that checked sort columns are added to the Master output (leaving everything else to the detail output)?

I kept trying to click on the thing to configure it, and nothing happened--I almost thought it was broken. Just a little too intuitive. :)

April 28, 2009 1:10 AM
 

jamie.thomson said:

ranomore,

I'll get around to posting some screenshots at some point but in the meantime (for anyone else reading) all you need to know is that there is nothing, absolutely nothing, you need to do the Normaliser component to configure it. I have explicitly defined it to have no editor hence clicking on it won't do anything.

The only requirement is that the input is sorted. Nothing else.

"A little too intuitive". That sounds like a backhanded compliment if ever I heard one, or perhaps a backhanded insult :)

-Jamie

April 29, 2009 9:50 AM
New Comments to this post are disabled

This Blog

Syndication

Powered by Community Server (Personal Edition), by Telligent Systems