310 likes | 511 Views
Data Governance. How to Keep Your DG Program Viable for the Long Haul. ARC (Airlines Reporting Corporation). ARC is a technology solutions company providing transaction settlement and data information services. We manage the Global Travel Industry Data Warehouse
E N D
Data Governance How to Keep Your DG Program Viable for the Long Haul
ARC (Airlines Reporting Corporation) ARC is a technology solutions company providing transaction settlement and data information services. We manage the Global Travel Industry Data Warehouse $80B travel settlement sales a year 193 Million transactions annually Settle transactions with ~200 airlines ~2.5 B transactions stored in GDW ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 2
Why Data Governance Warehousing all US based travel agency sold airline tickets for 60+ months Data sharing implications across and among travel agencies, airlines, airline alliances, bankruptcies, mergers, etc. Sensitive data encryption and on-going management Internal data management and security Data is our business and data quality is our reputation At risk if data is exposed or lost EU Safe Harbor/PCI/other Compliance requirements ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 3
What is Data Governance? Work from the premise that Information is a Strategic Asset - Data is the very Lifeblood of your Business “Data governance is the act of managing the organization’s data assets in a way that promotes business value, integrity, usability, security, and consistency across the company” ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 4
High Cost of Point Solutions “Organizations that choose individual solutions (people, policies, procedures or technology) for each regulatory challenge they face will spend 10x more on compliance and governance than those that leverage each implementation for multiple requirements” Gartner Symposium ITxpo October 2005 ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 5
High Cost of Point Solutions “Organizations that choose individual solutions (people, policies, procedures or technology) for each regulatory challenge they face will spend 10x more on compliance and governance than those that leverage each implementation for multiple requirements” Gartner Symposium ITxpo October 2005 So, do you want this? ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 5
High Cost of Point Solutions “Organizations that choose individual solutions (people, policies, procedures or technology) for each regulatory challenge they face will spend 10x more on compliance and governance than those that leverage each implementation for multiple requirements” Gartner Symposium ITxpo October 2005 Or this? ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 5
An Evolutionary Approach Airlines Reporting Corporation 2008 CATEGORY WINNER DATA GOVERNANCE Non-Existent Ad Hoc Standardized Committed Consolidated Strategic 2003 Data Stewardship Program LDM & PDM Processes 2007 Begin to Standardize Data Definitions and Business Rules Formalize Data SLAs Internally & Externally 2009 Integrated CRM Implemented 2011 DG Integrated into Strategy, BSC, Risk Map Begin Work for ISO 27001 2005 Data Correction Process Formalized Data Profiling Tool Added PCI Compliance Achieved Dual Active DR Implemented Data Acquisition Strategy 2002 DW Implementation Initial Data Share Policies System Data Modeling System Data Mapping 2004 Chief Security Officer Added EU Safe Harbor Business Continuity Introduced ETL Tool Introduced Data Architects Added 2006 Enterprise Architecture Implemented Data Provisioning Introduced Data Quality & Integration Tools Standardized Data Models Capture Business & Technical details Data Incident Reporting Formalized 2008 TDWI Best Practice Award for Data Governance 2010 Metadata Strategy Proposed – in review – implementation TBD Chief Risk Officer Added ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 6
Keeping Your DG Program Viable & Relevant Non-Existent Ad Hoc Standardized Committed Consolidated Strategic Move to Strategic Maturity – see DG as a Strategic Priority • Put mechanisms in place to detect trends & patterns and react to them to gain new capabilities • Show agility while maintaining necessary controls • Improve capabilities of individuals and groups across the DG program (create a “volunteer army”) • Meet the evolving needs of the organization • DG as part of the Corporate Strategy Map, BSC, Strategic Initiatives, & on the Corporate Risk Map • Be seen as strategic, visible, impactful, relevant and part of the corporate culture • Deliver value to the organization ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 7
It’s a Balancing Act Balance across competing goals • Compliance goals that may limit data access vs. business needs that require expanded data access • Learning that the business goals must drive IT for overall strategic success • Data ownership challenges between the individual departments and the enterprise • Integrating data governance into many different business initiatives • Seeing data governance as a resource to move the organization forward, not as a role or headcount issue ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 8
Three P’s and a T Policies – Data Sharing Rules, PCI Compliance, Antitrust Policies Procedures – Data Acquisition, Data Quality, Data Profiling People – Access, Usage Rules, Data Stewardship Procedures People Technology – Data Quality, ETL, Meta Data Technology ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 9
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model Meta Data Management Data Sourcing and Staging Data Quality EDW Data Marts ETL BI ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 10
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model Business Users own data strategy and delivery DG has executive level sponsorship Ab Initio EME Meta Data Management Policies & Procedures are in place (may be automated) New initiatives follow the Information Model All tools are standardized across organization Data Sourcing and Staging BI (MSTR SAS TD SQL) Ab Initio Data Profiler Teradata & TD Data Marts Ab Initio ETL Business Rules shared component Business Definitions Bus/Op Metadata Work Flows Data Stewardship ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 11
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model Meta Data Management Data Sourcing and Staging BI (MSTR SAS TD SQL) Built Business Case for Meta Data Management Ab Initio Data Profiler Teradata & TD Data Marts Integrating into EA Infrastructure/Future State Ab Initio ETL ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 12
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model Ab Initio EME Meta Data Management Data Hub Technology receives and disperses data as required/defined Data Sourcing and Staging BI (MSTR SAS TD SQL) Ab Initio Data Profiler Teradata & TD Data Marts Ab Initio ETL ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 13
ARCs Data Governance Business Model Operations, Audit & Security Data Profiling On-Going Monitoring ARC Business Information Model Data is continuously inspected and issues resolved Shared, flexible validation rules Ab Initio EME Meta Data Management Integrated as part of the overall model Data Sourcing and Staging BI (MSTR SAS TD SQL) Data Quality Teradata & TD Data Marts Ab Initio ETL Rigorously enforced to ward against bad data Extensive exception handling ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 14
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model Transform based on shared business rules Extract required data from source Load to the source systems Meta Data Management Data Sourcing and Staging Data Quality EDW Data Marts ETL Started out using home grown solution BI Moved to an ETL Suite with an ROI of less than 2 years ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 15
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model Global Travel Industry Data Warehouse Part Deux Data Marts Built on Data Management Model Infrastructure Meta Data Management Data Sourcing and Staging Data Quality EDW Data Marts ETL BI Multiple Data Marts to support functional areas ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 16
ARCs Data Governance Business Model Operations, Audit & Security ARC Business Information Model BI Metadata Built on Data Management Infrastructure Model Multiple BI tools to support users Meta Data Management Data/Information ‘Built on the Fly’ is a challenge and must use shared services Data Sourcing and Staging Data Quality EDW Data Marts ETL BI Added Functionality of Data Visualization ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 17
ARCs Data Governance Business Model Operations, Audit & Security Operations stay in sync with DG Business Model ARC Business Information Model Role based security, robust access management, sensitive data management Audits – who did what, when and why? Model, data, DG process itself Meta Data Management Data Sourcing and Staging Data Quality EDW Data Marts ETL BI ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 18
Keeping Your DG Program Viable & Relevant Non-Existent Ad Hoc Standardized Committed Consolidated Strategic Move to Strategic Maturity – see DG as a Strategic Priority • DG as part of the Corporate Strategy Map, BSC, Strategic Initiatives, & on the Corporate Risk Map • Be seen as strategic, visible, impactful, relevant and part of the corporate culture • Deliver value to the organization ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 19
Keeping Your DG Program Viable & RelevantStrategic Plan Non-Existent Ad Hoc Standardized Committed Consolidated Strategic ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 20
Keeping Your DG Program Viable & RelevantBalanced ScoreCard Non-Existent Ad Hoc Standardized Committed Consolidated Strategic Financial Perspective: Significant % Revenue is tied to the creation of quality data products & services Customer Perspective: (Seen as) Secure & Trusted – PCI, Safe Harbor, ISO Process Perspective: Develop Quality Products & Services Build the Premier Source of Global Travel Data Proactively Manage Risk (DG Program is on the Risk Map) Learning Perspective: Develop Skills for the Future Maintain an Innovative, Performance-Based Culture ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 21
Mature DG Offers a Competitive Advantage Internally Efficiencies across the board Common Software Embedded Enterprise Data Governance Common Policies and Procedures Measurements and Changes Managed Externally Seen as a Leader in Data Governance (Best Practice Awards) RFP Responses (PCI Compliance, Safe Harbor) ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 22
Next Steps for ARC Metadata Impact Analysis Business Rules Engine Information Architects Automated Policies Continuous Data Inspection Next Generation Governance ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 23
ARC Best Practices to Share Develop a data-driven company culture Data Governance practices must be repeatable and easily integrated from project to project Provide a foundation that is scalable and modeled with an enterprise view Strong relationships between IS and the business must exist (or be established) On-going relationship building with external suppliers is a requirement (via SLAs) Create a data management strategy Strong audit and corporate responsibility focus Top down/Bottom up concurrent focus needed for continued success Create the ability to access data needs across organizational silos Strong internal employee training program on policies and procedures Remember Data Governance is a program, not a project – you’re on a multi-year journey – enjoy the ride ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 24
Questions? ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 25
Becky Briggs, BSMP, CMQ/OE, CBIP Data Steward Director – Office of Strategic Management ARC bbriggs@arccorp.com 770.870.0462 ARC PROPRIETARY AND CONFIDENTIAL. This document includes confidential information that is proprietary to Airlines Reporting Corporation (ARC). Disclosure of this document or any information contained herein to third parties is prohibited without the prior written consent of an authorized ARC officer. Obsolete versions of this document should be destroyed in a manner to prevent compromise of the information, e.g., shredding. 26