1 / 16

Data Warehousing

Virtual University of Pakistan. Data Warehousing. Lecture-21 Introduction to Data Quality Management (DQM). Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research www.nu.edu.pk/cairindex.asp National University of Computers & Emerging Sciences, Islamabad

sharon-kelly
Download Presentation

Data Warehousing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Virtual University of Pakistan Data Warehousing Lecture-21 Introduction to Data Quality Management (DQM) Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research www.nu.edu.pk/cairindex.asp National University of Computers & Emerging Sciences, Islamabad Email: ahsan101@yahoo.com DWH-Ahsan Abdullah

  2. Introduction to Data Quality Management (DQM) DWH-Ahsan Abdullah

  3. What is Quality? Informally Some things are better than others i.e. they are of higher quality. How much “better” is better? Is the right item the best item to purchase? How about after the purchase? What is quality of service? The bank example DWH-Ahsan Abdullah

  4. What is Quality? Formally “Quality is conformance to requirements” P. Crosby, “Quality is Free” 1979 “Degree of excellence” Webster’s Third New International Dictionary DWH-Ahsan Abdullah

  5. What is Quality? Examples from Auto Industry Quality means meeting customer’s needs, not necessarily exceeding them. Quality means improving things customers care about, becausethat makes their lives easier and more comfortable. Why example from auto-industry? DWH-Ahsan Abdullah

  6. What is Data Quality? What is Data?  Note Change the picture Emp_ID = 440 Height = 5’8” Weight = 160 lbs Gender = Male Age = 35 yrs Muhammad Khan All data is an abstraction of something real DWH-Ahsan Abdullah

  7. What is Data Quality? Intrinsic Data Quality Electronic reproduction of reality. Realistic Data Quality Degree of utility or value of data to business. DWH-Ahsan Abdullah

  8. Data Quality & Organizations Intelligent Learning Organization: High-quality data is an open, shared resource with value-adding processes. The dysfunctional learning organization: Low-quality data is a proprietary resource with cost-adding processes. {Comment: Put picture of person in water holding round tube with data written on it} DWH-Ahsan Abdullah

  9. Orr’s Laws of Data Quality Law #1 - “Data that is not used cannot be correct!” Law #2 - “Data quality is a function of its use, not its collection!” Law #3 - “Data will be no better than its most stringent use!” Law #4 - “Data quality problems increase with the age of the system!” Law #5 – “The less likely something is to occur, the more traumatic it will be when it happens!” DWH-Ahsan Abdullah

  10. Total Quality Control (TQM) Philosophy of involving all for systematic and continuous improvement. It is customer oriented. Why? TQM incorporates the concept of product quality, process control, quality assurance, and quality improvement. Quality assurance is NOT Quality improvement DWH-Ahsan Abdullah

  11. Exponential rise in cost Co$t of fixing data quality Cost of achieving quality Lowest Quality Highest quality • Defect minimization is economical. • Defect elimination is very very expensive. DWH-Ahsan Abdullah

  12. Co$t of Data Quality Defects • Controllable Costs • Recurring costs for analyzing, correcting, and preventing data errors • Resultant Costs • Internal and external failure costs of business opportunities missed. • Equipment & Training Costs DWH-Ahsan Abdullah

  13. Where data quality is critical? • Almost everywhere, some examples: • Marketing communications. • Customer matching. • Retail house-holding. • Combining MIS systems after acquisition. DWH-Ahsan Abdullah

  14. Characteristics or Dimensions of Data Quality DWH-Ahsan Abdullah

  15. Completeness Vs Accuracy 95% accurate and 100% complete OR 100% accurate and 95% complete Which is better? Depends on data quality (i) tolerances, the (ii) corresponding application and the (iii) cost of achieving that data quality vs. the (iv) business value. DWH-Ahsan Abdullah

  16. Characteristics or Dimensions of Data Quality DWH-Ahsan Abdullah

More Related