280 likes | 308 Views
Learn how to boost productivity, quality, and cost-efficiency by applying software reuse concepts to Data Warehouse Loader implementation.
E N D
Applying Concepts of Software Reuse to the Implementation of Data Warehouse ETL Systems Jiayang ZhouNovember 2001
Applying concepts of software reuse to Data Warehouse Loader Fundamental of software reuse Description of Data Warehouse Loader Implementation of Data Warehouse Loader Reuse Analysis of Data warehouse Loader Summary Data Warehouse Loadersd&m
Applying concepts of software reuse to Data Warehouse Loader Fundamental of software reuse Description of Data Warehouse Loader Implementation of Data Warehouse Loader Reuse Analysis of Data warehouse Loader Summary Data Warehouse Loadersd&m
Definition of Software reuse Software reuse is a process of implementing or updating software systems using existing software assets. design model domain architecture database schema plan documentation test scenario manual standards code software components objects software requirements analysis Data Warehouse Loadersd&m
Importance of Software reuse • Increases productivity • Enhances quality • Saves cost • Reduces software development schedules • Reduces maintenance • Enhances standardization • Increases portability Data Warehouse Loadersd&m
Applying concepts of software reuse to Data Warehouse Loader Fundamental of software reuse Description of Data Warehouse Loader Implementation of Data Warehouse Loader Reuse Analysis of Data warehouse Loader Summary Data Warehouse Loadersd&m
Architecture of data warehouse application Data Warehouse Loadersd&m
Features of data warehouse • A data warehouse is a • Subject-oriented • Integrated • Time-variant • Non-volatile • collection of data for management’s decision making process. Data Warehouse Loadersd&m
The role of Data Warehouse Loader • Extraction: extract raw data from different source system • Transformation: transform data in order to be fit into the architecture of data warehouse • Loading: import data into data warehouse
The requirements of Data Warehouse Loader • Adaptability to any data source systems • Adaptability to any target data warehouse • High operation speed • Ability to deal with large amount of data • Flexibility for data transformation • Portability Data Warehouse Loadersd&m
The reuse consideration of Data Warehouse Loader Data Warehouse Loadersd&m
Applying concepts of software reuse to Data Warehouse Loader Fundamental of software reuse Description of Data Warehouse Loader Implementation of Data Warehouse Loader Reuse Analysis of Data warehouse Loader Summary Data Warehouse Loadersd&m
Architecture of Data Warehouse Loader Data Warehouse Loadersd&m
Loader-engine Data Warehouse Loadersd&m
Loader-interface • Extraction-interface: access to data source • Transformation-interface: different transformation scheme • Database-interface: access to data warehouse for updating and retrieving • Record-interface: construct an object structure for each database record Data Warehouse Loadersd&m
Format of intermediate file • INFO header • FORMAT header • DATA body Data Warehouse Loadersd&m
Applying concepts of software reuse to Data Warehouse Loader Fundamental of software reuse Description of Data Warehouse Loader Implementation of Data Warehouse Loader Reuse Analysis of Data warehouse Loader Summary Data Warehouse Loadersd&m
Reuse development of Data Warehouse Loader • Thorough examination of application requirements • Good documentation • Choosing of Java as programming language • Concrete separation of specification from a particular application Data Warehouse Loadersd&m
Advantages of workflow architecture • Easy maintenance • Module reuse • Temporally decoupling • Manageable and controllable programming • Re-composition of operation sequence Data Warehouse Loadersd&m
Re-composition of operation sequence Data Warehouse Loadersd&m
Appling concepts of software reuse • Code reuse • Adaptability • Modularity • Interface Data Warehouse Loadersd&m
Reuse architecture of Data Warehouse Loader Data Warehouse Loadersd&m
Package overview of Data Warehouse Loader Data Warehouse Loadersd&m
Applying concepts of software reuse to Data Warehouse Loader Fundamental of software reuse Description of Data Warehouse Loader Implementation of Data Warehouse Loader Reuse Analysis of Data warehouse Loader Summary Data Warehouse Loadersd&m
START-MDB project Data Warehouse Loadersd&m
Java and C • Java • slow and large RAM consumption • portability and platform-independence • easy for flexibility • object-oriented feature • C • fast • migration between different systems • difficulty for flexibility Data Warehouse Loadersd&m
Thank you very much for your attention! meg.zhou@sdm.com Data Warehouse Loadersd&m