Data Quality Services SSIS component error

Debugging Errors in SSIS Data Quality Services Cleansing Component

As part of Microsoft’s push to include business users in the Business Intelligence space, the addition of Data Quality Services to SQL Server’s feature set opened up the ETL process to the people who, arguably, know the data best.  Integration with SSIS was a great move, meaning that this user control extends to automated processes, further closing the gap between data and the business.

However, like most new components, Data Quality Services has some teething problems, and these can be quite hard to find when debugging your SSIS packages.  Here’s a quick tip that should help solve some of those tricky to find DQS issues. Continue reading “Debugging Errors in SSIS Data Quality Services Cleansing Component” »

Cortana's response to asking "what is rampancy"

Windows Phone, meet Cortana (just watch out for Halo spoilers)

Warning: This post contains spoilers regarding the ending of Halo 4.  You’ve been warned.

 

I’ve been spending some time with a special lady lately.  She’s always with me, and has been helping me organise my life.  She’s not all work though, and has shown that she knows a joke or two, she’s sassy, and she loves to talk about Halo.  I am of course, talking about one of Windows Phone 8.1′s killer features: Cortana. Continue reading “Windows Phone, meet Cortana (just watch out for Halo spoilers)” »

SQL Server example of datetime and datetime2

Mapping C# DateTime to SQL Server datetime2 via SSIS

With SQL Server 2008, Microsoft introduced the new, improved datetime2 format.  This newer time storage format is great, because it takes up less storage space, plus you have control over precision and can define your field to the exact specification required.  Database columns defined as datetime2 can be mapped in SSIS by using the DT_DBTIMESTAMP2 type.  However, in the scenario where you may have a Script Transformation in your SSIS package, and want to assign a .NET DateTime type to a Data Flow column that is mapped to a datetime2 field, you might encounter a DoesNotFitBufferException.

The reason for this is likely down to your specified field precision, and is easily fixed. Continue reading “Mapping C# DateTime to SQL Server datetime2 via SSIS” »

Case sensitivity in SSIS Lookup Transformation

Something that catches out a lot of new SSIS developers.  The caching mode used for a Lookup Transformation may affect case sensitivity.

The Full Cache option is case sensitive by default.  Partial and No-cache options use the Collation setting of the database (or table) to handle case.

Of course, using Partial or No-caching results in the SSIS package issuing a call to the database for each row in the data flow, so use them wisely!

Network graph visualising Man City vs Bolton by Eigenvector Centrality

Visualising a football match as a Network Graph using Gephi

Ever since getting my hands on some Opta data, courtesy of Manchester City’s Analytics challenge all the way back in August 2012, I’ve been wanting to try something different with the data.  Although it’s taken me over a year to get around to doing it, I’d initially thought of the idea of doing some kind of Network Graph to explore how the players were interconnected throughout a match, and potentially over an entire season.  Since starting to play with Gephi some time ago, I figured it would be perfect for the job. Continue reading “Visualising a football match as a Network Graph using Gephi” »