330 likes | 349 Views
Data Warehouse (I): Introduction. Lecture 2 Developed by: Dr Eddie Ip Modified By: Dr Arif Ansari. Overview. Functions of DW Definition & characteristics of DW Why DW and why it is possible now Business perspective Technical perspective Examples of analytical functions of DW
E N D
Data Warehouse (I): Introduction Lecture 2 Developed by: Dr Eddie Ip Modified By: Dr Arif Ansari
Overview • Functions of DW • Definition & characteristics of DW • Why DW and why it is possible now • Business perspective • Technical perspective • Examples of analytical functions of DW • Evolution of DW
Functions of a DW • Creates a physical separation between the collection of daily transaction data and a copy of it. Use copy for analytical purposes • Avoid engineering conflict • Challenges • E.g., Scattered data create political & technical challenges
Definition of DW • “A collection of integrated, subject-oriented databases designed to supply the information required for decision-making.” - W. Inmon (1992)
Integrated • From many operational systems, or OLTP’s(= On-Line-Transaction-Processing) to form an integrated view of the customer
OLTP • Handle a business’s daily activities & commerce • “Bread and butter” activities
OLTP • ATM, airline reservation, catalog order, supermarket (bar-code data)
OLTP • Can think of it as “A data storage with blinking data items” (regular and frequent updating activities)
OLTP • Based on well-defined business & technical requirement • Large volumes of simple transactions • Rigid specs • Maintained by IT professionals • Process oriented
OLTP • Store in relational database tables or hierarchical files • Supports many users • Frequently updated
OLTP • Does not support • analysis • ad hoc query & reporting • multiple platform • evolution
Subject Oriented • Subject oriented (DW) vs process oriented (OLTP) • Subjects: customers, sales, profits
Databases • DW requires a large repository (DB) • DW = internal DB + external DB + metadata DB
Decision Making • Dimensional view of data • Start from a high level (summary data) & drill down to more detail to answer specific questions • Function similar to Executive Information System (EIS)
Characteristics of DW • DW takes a snap-shot of operation & stores it away • Allows trend/ pattern analysis • Read-only
Characteristics of DW • DW stores atomic & lightly summarized data • Summarized = aggregates • Trade-off consideration • performance • cost
Why DW? • Business perspective • Quick decision
Why DW? • Quick decisions • “The ultimate goal is simple: Give the battlefield commander access to all the information needed to win the war. And give it to him when he wants it, where he wants he and how he wants it.”-- Gen. Colin L. Powell, “Information Warriors,” BYTE, 1992
Why DW? • A single, integrated view of customer • Data integrated from across, and even outside organization
Why DW? • Business perspective • Users are business domain experts, not computer professionals • Leverage fast growing data assets (new source of information, new way of looking) • Competitive edge, e.g. mass customization, operational excellence • Infrastructure forms backbone in supporting relationship management*
Why DW? • Technological perspective • Information scattering (stovepipe DB) • Price of computing dropping • Network bandwidth increasing • Advances in technology, e.g. web, DM tools, distributed computing • Integration of legacy systems • Security enhancement
Analytical functions • Examples • Sales analysis : sales analysis, inventory analysis, identify inactive customers • Financial analysis: review past cash flow trends & forecast future needs, real-time financial reporting
Evolution of DW as a decision support tool • Long history of analytic system • 1970 DSS = decision support systems • 1980 EIS = executive information systems • Reporting system for senior managers
EIS example • Frito-Lay
Pre-DW DSS • Lack DB component • Extract programs subset files (predetermined criteria) • Problems: reliable joins, synchronization, credibility, consistency • Process controlled by IT, not business users • Silos (one OLTP, one DSS)
Modern DSS Example • Stock Screen • Used by security analysts to inform & support business decision
Modern DSS Example • A simple web-based mutual fund screen • Charles Schwab
The Ins and Outs of DW • OLTP bring data in • DSS draw data out • Many still consider DW a kind of DSS
Summary • DW is physically separated from OLTP • DW provides the basis (memory, analytics) to achieve enterprise intelligence • Business & technical requirements (e.g., user interface, subject orientation) • DW is a kind of DSS
Glossary • DW: Data Warehousing • OLTP: Online Transaction Processing • EIS: Executive Information System • DSS: Decision Support System