Welcome to EMC Consulting Blogs Sign in | Join | Help

SSIS Junkie

SSIS: Lessons learned

As I said on a previous post I am now building SSIS packages in anger on a proper project and learning stuff all the time. Here's some important lessons learned from today.

1. Use DTExec. Allan and Darren have already made the point (http://www.sqlis.com/default.aspx?84) but its worth reiterating. Run your packages using DTExec if at all possible. I had a package execute in 845 seconds when executed from BIDS, 201 seconds from DTExec.

2. Beware of raising events. In the same package I was using a script component to add rows into the pipeline from a web service. I generated 2 OnInformation events for each row put into the pipeline. I didn't think this would be much of an overhead because there was only 103 rows but when I removed the OnInformation events the execution time reduced again from 201 seconds to 54 seconds. This is largely because of the heavy processing I do in my eventhandlers but it demonstrates that if you're doing this then you need to be wary.

-Jamie

 

Published Monday, October 17, 2005 7:11 PM by jamie.thomson

Comments

 

Scott Barrett said:

Jamie,

I'd like to like your blog into mine and wanted to know if you were OK with that. Check mine out and see if it warrants being on your blog roll....

http://microsoftdw.blogspot.com/

Thanks,
Scott Barrett
scott(at)barrettzone.com
November 11, 2005 1:59 PM
New Comments to this post are disabled

This Blog

Syndication

Powered by Community Server (Personal Edition), by Telligent Systems