Balanced Data Distributor (BDD) for SQL Server 2012 is Now Available

The Balanced Data Distributor (BDD) transform has updated and released for SQL Server 2012. The BDD transform makes it easy to split your data flow up on a buffer-by-buffer basis. The two primary scenarios for it are when you want to do parallel inserts into a destination… … and when you want to parallel work…


SSIS Presentations from SQL Bits Available Online

Three slide decks from the SSIS presentations I did at SQL Bits X in London have been posted online. These include: SSIS Performance Design Patterns – full day training session! What’s New in SSIS for SQL Server 2012 – breakdown of the new features and functionality in SQL Server 2012 SSIS Catalog – Overview of…


SSIS Case Study – Innovapost

An interesting case study about how SSIS is used by Canada Post has recently been published. The article mentions how they built an SSIS scale-out solution which processes 10-15 GB of data per day (with four worker nodes). Definitely an interesting read! If you’d like to know more about building your own scale-out solutions with…


Using the PipelineComponentTime event

Today’s post is from Wee Hyong Tok – a Program Manager on the SSIS team based in Shanghai. It covers the PipelineComponentTime event, which was introduced in SQL Server 2008, and talks about how the event can be used in SQL Server Denali. The PipelineComponentTime event is a very useful custom log entry used for…


Troubleshooting SSIS Package Performance Issues

Today’s post is from Wee Hyong Tok, a Program Manager with the SSIS team based in Shanghai. It provides some tips on using T-SQL to analyze performance issues for packages running on the new SSIS Catalog. For more information about the new logging functionality in Denali, see Jamie Thomson’s post about report authoring. When an…


The Right Tool for the Job

Most of this content comes from my Performance Design Patterns series. If you’re interested in learning more about SSIS Design Patterns, I’ll be doing full day pre-conference training sessions at the PASS Summit and SQLBits. ———- Whenever I’m presenting a session about SSIS performance, I like to start off with the following slide: SSIS is…


Pattern: Replacing NULL values with a Derived Column

This pattern has been out there for so long I had contemplated taking it out of my Performance Design Patterns talk, but it looks like it still managed to help some people at SQL Saturday #71 last weekend. This pattern is straight forward, and especially important since the data flow threading improvements were made in…


Why does my package run slower in BIDS than DTEXEC?

Jamie Thomson recently suggested that you should run your packages using DTEXEC when doing performance testing, as it (typically) performs much better then when the same package is run in BIDS. If you haven’t already read it, go do that now. It has a pretty picture in it and everything. I’ll wait. The purpose of…


Speeding up Derived Column Transforms

A new technical note about splitting up transforms to increase performance has been posted on the SQLCAT site. It’s something you want to consider when you’re using synchronous transforms (like Derived Column, or Data Convert) to perform actions on a large number of columns. It seemed like black magic at first, but if you consider…


Optimizing the Slowly Changing Dimension Wizard

As a follow-up to my previous post about SCD processing in SSIS, I thought I’d go deeper into using the built-in Slowly Changing Dimension Wizard. While there are definitely more efficient ways to do SCD processing in SSIS, there are some optimizations you can apply to the components that the wizard outputs that might make…