1 / 45

Data Quality Services + What’s new in SSIS in SQL Server 2012

Data Quality Services + What’s new in SSIS in SQL Server 2012. James Beresford www.bimonkey.com @ BI_Monkey. But first…. Data Quality Services SQL 2012 RC0 Edition. The Data Q uality problem. !=. Hands up if you’ve been 2 years old. Your first data quality problem.

fathia
Download Presentation

Data Quality Services + What’s new in SSIS in SQL Server 2012

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Quality Services+What’s new in SSISinSQL Server 2012 James Beresford www.bimonkey.com @BI_Monkey

  2. But first….

  3. Data Quality Services SQL 2012 RC0 Edition

  4. The Data Quality problem !=

  5. Hands up if you’ve been 2 years old

  6. Your first data quality problem

  7. Data Quality = Shape Sorting

  8. There is Good Data

  9. There is Bad Data

  10. There is Repairable Data

  11. Data Quality Services Terms A Shape = Domain

  12. Data Quality Services Terms Collection of Shapes = Knowledge Base

  13. Data Quality Services Terms Shape Sorting = Domain Rule

  14. The Data Quality Client • Allows you to: • Create or Maintain • Knowledge Bases • Data Quality Projects • Manage and Configure DQS

  15. The Data Quality Client Create a Knowledge Base

  16. The Data Quality Client Create a Knowledge Base • What did we see? • Create a Knowledge Base from Data using Knowledge Discovery • Set values as Correct, Error or Invalid • Teach the KB some simple auto correction usingDomain Rules

  17. The Data Quality Client Pop Quiz: Who owns a Knowledge Base? Maintaining KB’s is done by: Qualified Data Professionals A BI Developer Users Tony Abbott

  18. The Data Quality Client Pop Quiz: Who owns a Knowledge Base? Maintaining KB’s is done by: Qualified Data Professionals A BI Developer Users Tony Abbott

  19. The Data Quality Client Create a Composite Domain n +

  20. The Data Quality Client Create a Composite Domain • What did we see? • Use values from one domain to affectanother

  21. The Data Quality Client Other Domain Functions • Things that I won’t demonstrate • Term Based Relations– autocorrect substrings (e.g. Inc. > Incorporated) • Reference Data – Validation against external sources on Azure DataMarket, e.g. Melissa Data

  22. The Data Quality Client Create a Data Quality Project

  23. The Data Quality Client Create a Data Quality Project • What did we see? • Interactive Cleansing of data • Export of cleansed data set

  24. The Data Quality Client Matching Policies • Fuzzy & Domain matching • Matching Polices • Exact – Must match to count in score • Similar – Approximate match counts • Prerequisite – Must match or match fails • De-Duplication

  25. Automation with SSIS

  26. Automation with SSIS The DQS Cleansing Task

  27. What’s new in SSIS Denali CTP3 Edition

  28. What’s new in SSIS Projects & Parameters

  29. What’s new in SSIS The SSIS Catalog

  30. What’s new in SSIS Developer Experience • Visual Studio 2010 & .Net 4 support • Undo / Redo • Auto-save project recovery

  31. What’s new in SSIS Developer Experience New Toolbox

  32. What’s new in SSIS Developer Experience • Expressions • New Expressions • LEFT • TOKEN • TOKENCOUNT • Removal of 4000 character limit

  33. What’s new in SSIS Developer Experience New Data Flow Column Mapper

  34. What’s new in SSIS Developer Experience Expression Markerson icons

  35. What’s new in SSIS Developer Experience VariableWindow improvements Package Scope by Default Change Scope button

  36. What’s new in SSIS Developer Experience Data Quality Services Integration – DQS Cleansing Task

  37. What’s new in SSIS Administration Experience • Simplified deployment & configuration • Automatic logging • Management dashboard • Built-in reports • Improved SSMS management experience • Advanced troubleshooting features • Package performance analysis

  38. What’s new in SSIS SQL 2012 RC0 Edition

  39. What’s new in SSIS Developer Experience Change Data Capture

  40. What’s new in SSIS Developer Experience • ODBC Support • Source and Destination Adapters

  41. What’s new in SSIS Developer Experience Connection Manager Changes

  42. What’s new in SSIS Developer Experience Flat File Source Improvements

  43. What’s new in SSIS Developer Experience • Package Format Changes • Visual Studio Configurations • Scripting Improvements • Troubleshooting & Logging

  44. What’s new in SSIS Administration Experience • Data Taps • Server Management with PowerShell

  45. What’s new in SSIS Developer Experience Other Changes • Updated look for the Control Flow and Data Flow • Pivot UI • Row Count UI • New Expression: ◦REPLACENULL • BIDS is now SQL Server Data Tools • Many small fixes and improvements based on CTP feedback

More Related