Design Patterns

Consistent Design Patterns and SSIS Frameworks

Consistent Design Patterns and SSIS Frameworks

Question: How do I make sure everyone at my company is using the same SSIS framework and design patterns? SSIS Design Patterns and frameworks are one of my favorite things to talk (and write) about. A recent search on SSIS frameworks highlighted just how many different frameworks there are out there, and making sure that … Continued

Slides from SSIS Performance Design Patterns | TechDays Hong Kong 2013

Slides from SSIS Performance Design Patterns | TechDays Hong Kong 2013

The slides from my 3rd presentation at the TechDays Hong Kong event are now available. As I mentioned during the talk, design patterns are one of my favorite topics, and something I really enjoyed writing about. This presentation had a subset of the SSIS Performance Design patterns in the full day training sessions I’ve done … Continued

Lookups with really big reference tables

Lookups with really big reference tables

Recent customer issue: We are using the Lookup Transform to do joins in our Data Flows. Most Data Flows have more than one Lookup. The process worked fine in our development environment, but fails when we run in production because the source of the lookups have between 4-6 billion records each. How can we resolve … Continued

SSIS Design Patterns During the 24 Hours of PASS

Jessica Moss (Blog | Twitter) and Michelle Ufford (Blog | Twitter) will be presenting SSIS Design Patterns for Fun and Profit during the Fall 2012 24 Hours of PASS event to promote our pre-con session and the SSIS Design Patterns book. They are Session 15 on the schedule, which means they’ll be presenting on Friday, … Continued

Dynamic Execution of Child Packages with Different Parameters

Dynamic Execution of Child Packages with Different Parameters

SSIS 2012 introduces the concept of Parameters – a more explicit way of configuring your SSIS packages that you can use with the Project deployment model. The Execute Package Task was updated to support binding variables in the parent package to parameters in the child package (an alternative to the Parent Variable Configurations in SSIS … Continued

SQL Server 2012 Integration Services Design Patterns comes out tomorrow!

SQL Server 2012 Integration Services Design Patterns comes out tomorrow!

My first SSIS book – SQL Server 2012 Integration Services Design Patterns (Apress) – will be released tomorrow (9/5). In addition to some of the design patterns that I typically talk about in my presentations, it has some great content from the co-authors on the book – Andy Leonard, Tim Mitchell, Jessica Moss, and Michelle … Continued

PASS Summit 2012 – SSIS Pre-Conference Event

PASS Summit 2012 – SSIS Pre-Conference Event

Well, I guess Andy, Tim & I did a good job at PASS last year, as we’ve been invited back to present another SSIS pre-conference event at the 2012 PASS Summit. This time we’ll be joined by the co-authors of our SSIS Design Patterns book, Jessica Moss and Michelle Ufford.   SSIS Design Patterns Speaker(s): … Continued

SSIS Performance Design Patterns

Here are the slides (all 177 of them) for the SSIS Performance Design Patterns talk that I’ve delivered at three different pre-conference events over the past month. Each presentation was slightly different, but the core content remained the same. These events included: SQL Saturday #105 | Dublin SQL Bits X, where I co-presented with John … Continued

Speaking at SQL Saturday #105 in Dublin, Ireland

Speaking at SQL Saturday #105 in Dublin, Ireland

I’m honored to be presenting at SQL Saturday #105 in Dublin, Ireland on March 24th. They recently added a 4th session track to keep up with demand, and I was more than happy to fill in one of the timeslots with a session about the developer experience enhancements in SSIS 2012. I’ll also be covering … Continued

Design Pattern: Avoiding Transactions

Design Pattern: Avoiding Transactions

SSIS has built-in support for transactions, but their use isn’t ideal for all scenarios. This post covers how SSIS transactions work at a high level, some of the challenges associated with them, and provides some design alternatives. Disclaimer: Many SSIS packages use transactions without issue. Using the built-in functionality is the easiest approach, and (typically) … Continued