Welcome to EMC Consulting Blogs Sign in | Join | Help

SSIS Junkie

Once upon a time this blog was a hive of activity. Now however its pretty lifeless as you can probably tell so if are pining for more of the same you can find me over at http://sqlblog.com/blogs/jamie_thomson. I look forward to seeing you there!

SSIS: Lookup with value range

A short post to point out a great blog posting from Julian Kuiters explaining how you can configure the LOOKUP component to do lookups based on ranges. Here's the link: http://www.julian-kuiters.com/article.php/ssis-lookup-with-range

Julian points out the value of being able to modify the SQL statement that populates the lookup cache. I'm sure there are many scenarios in which this could be useful.

-Jamie

 

Published 29 March 2006 00:00 by jamie.thomson

Comments

 

John Welch said:

One caveat with using this technique - or any that require you to enable memory restriction - SSIS will execute a seperate query for each lookup value not found in the cache, and the cache starts empty. If memory restriction is not enabled, the entire table or query is cached in memory as the first step of the lookup, then each row can be matched without executing another query.
If this is a small table, or most of your input rows have the same lookup value, it may not be much of a hit. But if you have a large number of unique lookup values in your input, it can really impact performance.
Another workaround for this is to do the lookup as a join in your Data Source query. It can cause issues if your lookup table is on a different server than your source, but  that can be worked around with temp tables.
March 29, 2006 16:37
 

Simon said:

I covered Range lookups a while back, as John mentioned modifying the SQL in the Lookup is bad for performance. My post includes some code for a custom transform to do a range lookup.
April 11, 2006 16:45
New Comments to this post are disabled

This Blog

Syndication

Powered by Community Server (Personal Edition), by Telligent Systems