120 likes | 282 Views
Data Cleansing with SSIS. Brian Knight Pragmatic Works bknight@pragmaticworks.com. About Brian. SQL Server MVP Founder of Pragmatic Works Author of 13 books Blogs at BIDN.com Twitter: @ BrianKnight. Wasn’t very good with girls Even Kermit the Frog founded a company
E N D
Data Cleansing with SSIS Brian Knight Pragmatic Works bknight@pragmaticworks.com
About Brian SQL Server MVP Founder of Pragmatic Works Author of 13 books Blogs at BIDN.com Twitter: @BrianKnight Wasn’t very good with girls Even Kermit the Frog founded a company All 13 still awaiting a publisher. BI Savvy or BI Curious?
Takeaways • Profiling the data • Cleansing and validating with scripts • Fuzzy techniques
Data Profiling • Retrieves metadata about your data • Help identify data issues • Uses an SSIS Data Profiling Task
Data Profiling Task Demo
Scripting in SSIS • Tasks • Data Flow • Source • Transform • Destination
Cleansing Uses in Scripting • Advanced data cleansing • Complex data validation • Unusual data sources
Fuzzy Techniques • De-duplicating data • Fuzzy catches misspelt words or variants • Fuzzy Grouping and Fuzzy Lookup
The End Already? • Questions http://www.bidn.com/people/brianknight @BrianKnight bknight@pragmaticworks.com http://www.youtube.com/pragmaticworks