240 likes | 582 Views
What is Metadata?. Data about data. Metadata describes how and when and by whom a particular set of data was collected, and how the data is formatted. Is an evolving process. What. What is the content & structure of the metadata?
E N D
What is Metadata? • Data about data. • Metadata describes how and when and by whom a particular set of data was collected, and how the data is formatted. • Is an evolving process. http://www.avssystems.org
What • What is the content & structure of the metadata? • Data Structure (Name, Type, Length, Precision, Scale, Null/Not Null, Default Values, etc) • Business and Technical Rules • Transformation Rules • Algorithms and Functions used http://www.avssystems.org
How • How will metadata be collected, maintained and deployed? • Metadata Repository maintained in Oracle will be used as a HUB. • Collecting metadata from various tools: • Capture modeling metadata from Erwin, Oracle Designer • Capture process metadata from Informatica ETL • Capture reporting metadata from Actuate and through various pre-defined text templates. • Capture process, business logic from Oracle RDBMS • Connect and provide end-to-end metadata • The information can then be disseminated via a browser. http://www.avssystems.org
Where • Where does the metadata reside? • Metadata will reside in a Metadata Repository in Oracle Database that is either local to each specific department or central as part of the enterprise implementation. http://www.avssystems.org
Who • Who are the consumers of the metadata? • Business users • Technical users. http://www.avssystems.org
When • When is the metadata to be populated, with what frequency? • The metadata can be populated on a pre-defined regular basis. • Whenever a change occurs, the metadata can be imported into the repository and refreshed for the browser. • The metadata can be disseminated on a subscribe/publish policy. http://www.avssystems.org
Why • Why do you need this information? • Information about the movement of data within their organization. It improves the productivity of information for system designers, developers and administrators. It enhances the reliability of solutions. • Data Lineage provides the information regarding the source of the data and the typical changes that occurred with this data. • Data confidence provides the data quality details (good or bad). • Managing data assets and SLA’s with outside vendors. http://www.avssystems.org
Continued… • Reporting capabilities • Impact Analysis • Process Analysis • Reusability • Data Integration • Business definition • Business applicability • Business rules applied. http://www.avssystems.org
Metadata Classification The metadata is classified into 2 categories. • Technical Metadata • Business Metadata http://www.avssystems.org
Technical Metadata • Data Lineage Analysis • Process Analysis • Impact Analysis • Source-to-target mapping • Reusability • Auditability • Data Structure • Data Definition • “The Defense of the Warehouse” http://www.avssystems.org
Business Metadata • Business Rules – (definitions, changes, algorithms, etc) • Data Lineage – (source of data and its lineage) • Source-to-target mapping • Searchability – (where and how it is stored) • Usability – (where and how it is used) • Hide technological constraints – (no need to worry about technical jargon) http://www.avssystems.org
Goals and Objectives • To promulgate best practices across the enterprise • Create Standards and Guidelines • With blessings from Management, implement the desired standards http://www.avssystems.org
Metadata Framework • End-to-end integration (desired) Informatica ETL D ATA - M O D E L Legacy/MF XML Dashboards Data Mart Acquisition Aggregate/ Metrics Calc Cleansing Warehouse Bus OLAP Enterprise Data Warehouse E-Apps INFO DELIVERY Transformation Application Integration Layer Data Mart Load Load Relational Portals ERP/CRM External Metadata Integration (Rochade) http://www.avssystems.org
Recommended • Use ETL for data movements • The next step is to embark on changing appropriate applications to load thru Informatica Powercenter wherein all the business and technical rules will be captured and made part of metadata repository via Rochade http://www.avssystems.org
Quotes • The Opposite to metadata management is looking at information blind-folded. • Metadata is one of the biggest critical success factors to sharing information …and storing information cost-effectively. • Simply put, metadata management is making metadata do more things for more people in more ways, more economically.” • Everybody wants Metadata. It is hard work. Understand it properly and execute it. Do not build another variation of silo. http://www.avssystems.org
AVS SYSTEMS • AVS has build 15 years of solid experience in the Data Warehouse, Metadata Management and Business Intelligence. • Centered around this practice is huge wealth of experience involving various tools and services • We have done it before successfully and we can deliver it for you too. • We always believe in honesty, reliability, dependability when it comes to service. • Our service is unique and cost-effective. Take advantage. http://www.avssystems.org
CONTACT US • Andy Vaidya • AVS SYSTEMS, INC 9 Colt Circle Princeton Junction NJ 08550-2248 Tel: (609) 649-4174 Email: andyvaidya@avssystems.org Website: http://www.avssystems.org http://www.avssystems.org