Automating the data matching process in SQL Server Data Quality Services (DQS)

OH22 data has just released a free SSIS transform task for SQL Server Data Quality Services (DQS) matching. The solution is published on codeplex. With this custom transform task, you can use the Knowledge Base (KB) created in DQS to automate data matching through SSIS.     In this article, I am going to walk through using…

23

Cleansing Customer Data Using Data Quality Services (DQS)

SQL Server 2012 Data Quality Services (DQS) enables you to cleanse data using your own Knowledge Base. In this blog article, I am going to show how to create a simple Knowledge Base which you can use to cleanse your customer data. The steps for using DQS to cleanse data is as follows: A. Create…

15

Using the SSIS DQS Cleansing Component

  As part of our DQS CTP3 offering, we are releasing a new DQS SSIS component. This component incorporates the DQS cleansing functionality into an SSIS data flow.   When should I use the SSIS DQS Cleansing Component? The DQS Cleansing component can add value when: 1.       Cleansing should be performed as a batch process….


Installing and Configuring Data Quality Services

  After you’ve downloaded Denali CTP3, it’s time to install DQS! Here you can find some important information that will help you install and configure DQS successfully. Data Quality Services (DQS) contains three components: DQS server, DQS client, and a DQS Cleansing SSIS component. The DQS server is installed on top of the SQL Server Database Engine,…


Configuring SSIS DQS Domain Value Import

In the previous blog article, I described how to use the free SSIS DQS Domain Value Import from OH22 data to automate importing values into a DQS Knowledge Base domain. In this article, I will go over the optional configuration to import invalid/error value types as well as to set synonyms. First, let’s quickly recap the domain…

7

Matching Policy – A Closer Look into Data Quality Services Data Matching

This post demonstrates how you can create a matching policy in a knowledge base and tune it to achieve best results. The screenshots were taken from a later DQS build so you will probably notice some changes to the user interface and functionality comparing to the CTP3 build. What is a Matching Policy? You prepare…

7

Introduction to Data Quality Services Data Matching

It’s all about your data… Whether you are a small shop, mid-size or large organization, one of your most important asset is your data; organizations often spend hundreds of thousands or millions of dollars, a large portions of their information technology (IT) budgets on implementing sophisticated applications, data synchronization systems and data warehouses.Making large investments…

5

Pattern Matching in DQS Domain Rules

This post provides you information on how to use the pattern matching rules in DQS while creating domain rules. These are the four pattern matching rules in DQS:  For a pattern matching rule: Any  letter (A…Z)  can be used as a pattern for any letter; case insensitive Any digit (0…9) can be used as a…

4

Introducing Data Quality Services

Welcome to the SQL Server Data Quality Services Team Blog!     SQL Server Data Quality Services (DQS) is the new innovative data quality product delivered as part of SQL Server “Denali” release. DQS is a knowledge-driven data quality solution. It enables you to build a knowledge base, and use it to perform a variety…


Matching related and duplicate Customer Records using SQL Server Data Quality Services (DQS)

SQL Server Data Quality Services (DQS) enables you to match records using your matching rules defined in DQS Knowledge Base. There are two common use cases where you would like to match related records. One is to identify duplicate in your records, such as same customers appear as separate records in your dataset. Another common…

3