SSIS alternative to the Slowly Changing Dimension transformation

[via Jamie Thomson]

If you are transforming large dimensions this will be of interest to you.

 Alberto Ferrari has come up with an interesting solution to the performance of the SCD transform task. The built-in SCD transform issues separate SQL statements for each incoming dimension row, Alberto has a custom SSIS component here (http://www.sqljunkies.com/WebLog/aferrari/archive/2006/06/08/TableDifference.aspx) that compares two tables in one operation. It is definitely something I am going to look into next time I have to deal with a large Slowly Changing Dimension.

 

Update [2 Apr 2008]: Alberto has had a new blog for a little while now - you can now find him and the TableDiff component at www.sqlbi.eu

Print | posted on Wednesday, June 14, 2006 7:44 PM