Welcome to EMC Consulting Blogs

Browse by Tags

• Ab Initio
• best practice
• BizTalk
• Checkpoints
• Conchango
• configurations
• connection manager
• Datareader source adapter
• Demo
• DTS
• EngineThreads
• ExclusionGroup
• Execute SQL Task
• Expressions
• Federated Querying
• Foreach Loop
• fuzzy
• fuzzy logic
• Informatica
• lookup
• Microsoft
• Nugget
• ole db source adapter
• pipeline component
• raw files
• regex
• regular expressions
• RetainSameConnection
• Scripting
• SQL
• SQL Server
• SQL Server 2005
• sqL server 2008
• SQL Server Integration Services
• SSIS
• template
• T-SQL
• Variables
• video

• SSIS and embedded SQL

  I have been having an email back-and-forth with Jon Jaques which began with us discussing various limitations regarding BLOB support within the OLE DB Command and ended with Jon’s blog entry SSIS and the Perils of Embedded SQL where he discusses the drawbacks Read More... Posted 17 October 2008 10:13 by jamie.thomson | 8 Comments Filed under: SQL Server Integration Services, SQL Server, SSIS, Dataflow Task, Execute SQL Task

• SSIS Nugget: Conditionally email a file containing error rows

  Someone emailed me today asking: I have an SSIS package that outputs data that can’t be inserted into destination tables into flat log files [JT: I presume he means that error rows are redirected to a flat file] What is the easiest way to then after processing Read More... Posted 11 July 2008 20:02 by jamie.thomson | 6 Comments Filed under: SQL Server Integration Services, SQL Server, SSIS, Dataflow Task, Expressions, Demo, Nugget

• SSIS: SQL 2008 Benchmarks

  Microsoft have published some TPC benchmarks for SQL Server 2008 which you can read here . Of most interest to me was the final paragraph which stated: ETL Performance Application Company Result ETL Performance Unisys Load 1TB of data in less than 30 Read More... Posted 27 February 2008 20:01 by jamie.thomson | 6 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task

• SSIS: Case-sensitivity in Lookup component

  Jorg Klein has just written a useful blog entry about the SSIS Lookup component entitled "SSIS – Lookup Transformation is case sensitive" . Jorg correctly observes that: A lookup transformation uses full caching by default. This means Read More... Posted 12 February 2008 16:59 by jamie.thomson | 8 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task

• SSIS: Hiding columns in the pipeline

  Yesterday I received an email from a SSIS developer asking questions about some peculiarities of SSIS. One of the points she raised was thus: I found i spent alot of time trying to figure out how to get rid of un-needed fields in the flow. Not all transforms Read More... Posted 16 January 2008 02:12 by jamie.thomson | 2 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task

• SSIS: A performance tuning success story

  I believe it can be very useful to share success stories and case studies, particularly when a seemingly insurmountable problem has been overcome so I'm going to enjoy providing you with a SSIS success story right now. A guy going by the name Andy Read More... Posted 18 December 2007 19:56 by jamie.thomson | 3 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task

• SSIS: Dataflow expressions

  Did you know that it is possible to set expressions on components within the dataflow? Expressions on data-flow components was virtually the very last feature that was added to SSIS 2005 prior to RTM. All components CAN support expressions on their custom Read More... Posted 09 October 2007 05:12 by jamie.thomson | 7 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task, Expressions

• SSIS: Dataflow mechanics

  This is a post I've been meaning to write for some time but as you may have noticed my blogging output has been pretty lax lately. During my activity on the SSIS forum I've noticed that much of the content is in regard to the dataflow task and Read More... Posted 09 October 2007 04:39 by jamie.thomson | 25 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task

• SSIS: Normaliser Component bug fix

  17 days ago I released my Normaliser Component but embarrassingly it turns out there was a small bug. Any null values in the sorted columns on the component input would cause the component to throw a nasty unhandled error. I've fixed the bug in v1.1 which Read More... Posted 25 September 2007 05:44 by jamie.thomson | 7 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task

• SSIS: The Normaliser Component

  Scene Setting Its a common scenario when doing data integration that one has to process datasets containing redundant data. In many cases this is when data is received in flat files and all data is put into a single file for ease of transport. Perhaps Read More... Posted 07 September 2007 20:16 by jamie.thomson | 9 Comments Filed under: SQL Server Integration Services, SSIS, Dataflow Task, video