170 likes | 298 Views
EMC IT BI Strategy Update. Table of Contents. Information Management Core Disciplines Journey to Date Background Vision Progress to Date Example: BI Grid Opportunities Master Data Management / Data Quality. A. B. C. D. Information Management Core Disciplines.
E N D
Table of Contents • Information Management Core Disciplines • Journey to Date • Background • Vision • Progress to Date • Example: BI Grid • Opportunities • Master Data Management / Data Quality A B C D
Information Management Core Disciplines • Guarantees data availability where and when it is required • Movement and transformation of enterprise information • Interconnectivity of IT portfolio • Standardized formats and service interfaces – SOA • Identification and deduplication of shared master data • Cross-referencing and disambiguation • Hierarchy management • Data governance framework and stewardship processes • Unstructured data storage and management • Workflow-based publishing & versioning services • Tie-in to enterprise portal and user identity / security strategies Data Integration Master Data Management Content Management • Framework and organization to ensure management of data as a strategic corporate asset • Data stewardship • Policies and procedures; monitoring and measuring • Data warehouse methodology – envisioning to deployment • Business use-case- or function-specific datamarts / reporting solutions • Moving with agility fromreactive to predictive capability • Assurance that trustworthy data is accessible at time of demand • Standardization& cleansing • Business data rule enforcement • Stale data refresh • Augmentation from external sources Data Governance Business Intelligence Information Quality
BI Journey to Date • BI Roadmap launched in 2007 Objective:“Define the target BI and Reporting services delivery model which will serve as the compass for future BI projects, including: • BI Reference architecture • Services delivered from IT • Delivery Roadmap • Organization structure and processes needed to support delivery model“ • Assessment Included Identifying: • Limitations in the existing BI and Reporting environment • Capability gaps • Opportunities to improve efficiency and quality of service 2007“Assess” 2008 “Enable” 2009 “Prove” 2010 “Get Value” 2011… TOC
Architecture Findings • Architecture Findings: • Existing tool set was obsolete • Lacked advanced visualization • Aging infrastructure unable to scale • Redundant hardware and data • Disparate BI architectures • Complex support structure • Multiple points of reconciliation • No tiering or archiving strategy • Business Impact: • Customer dissatisfaction -> Shadow • Data is incomplete / quality • Increased infrastructure costs • Increased support costs • Increased Business costs ETL Source Systems DW Systems Marketing GS NRT Oracle 11.0.3 Oracle 11i Finance Sales IDW Peoplesoft HR SABA EDW eTime EAS CQDM
Governance Findings • Governance Findings: • Limited cross functional awareness • No cross functional prioritization • Inconsistent collaboration • Master Data management / • data quality ownership • Functional bottom up reporting • Business Impact: • Business lacks confidence in data • Reverts to gut based decisions • Analysts “fixing” data vs. using data • Redundant / wasted effort • Inconsistent metrics Sales TS Finance GS CQ Business BTG Sales BTG TS BTG Finance BTG GS BTG CQ BTG ERG COPS ERG G & A ERG GS ERG CQ Delivery NRT Sales / TS IDW Finance EDW GS IQDF CQ Assets
BI Cloud Vision Source Systems Y Analytical Users A Management Users Operational Users E L R E C S C S Oracle 11.0.3 A M O C M O N Oracle 11i Business Intelligence Peoplesoft Planning – Forecasting – Trending – Performance Management ETL Business Rules Analyze SABA Business Information Business Rules Applied – Actionable - Measures eTime Enterprise Information EAS Cleansed – Standardized – Consolidated - Reliable
Progress to Date • Projects: • OBI Enterprise • Infrastructure • OBI POC w/ SMF • Value: Foundational • Projects: • SMF • HR Analytics • GS Skills • BI Grid Replatform • FARM Tool • Value: NPV $4M • Projects: • GDW Wave 1 (CS) • GDW Wave 2 (Sales & Finance) • Corporate Quality • TS • Value: NPV $18.2M * Requested in budget
BI Grid: Live November 2009 Massive Performance Gains 10x Performance Gains for Day 1 Processing 180% improvement in batch job performance Datamart update times cut in half 200% improvement in dashboard rendering 2-3x performance improvement in reporting cube build time Platform for Future DMX to V-MAX Architecture First Deployment of EFD and Tiered Data Layout Unix to Linux Migration with 6 Node Grid Sun Solaris to X-86 Architecture Data ILM Services Configured for each Major Function IT Proven IT and Engineering Collaboration Development and Validation of Engineering Best Practices Publication of White Paper Engagement with Partners (Informatica and ZettaPoint) Reduction in backup time from 16 to 4 hours Significant Reduction in TCO 3X Reduction in Storage footprint Server footprint Consolidation of Databases Seamless Cutover 15 Billion Rows/10TB of Data Migrated End to end Leverage of EMC Technology 110 hour Cutover
Global Data Warehouse REVP REVT REVD EMC IT – Consolidated Oracle optimized Warehouse using Symmetrix V-MAX Primary Site Secondary Site Flash Drives – Objects with most stringent response time NRT Prod FC, SATA (R10) PASP OICP Fibre Drives – Objects from current & recent few quarters NRT Test SATA (R5) PAST OICT SATA Drives – Historical data NRT Dev SATA (R5) PASD Dynamic SRDF PRODUCTION FC, SATA (R10) DR EFD (R5) FC, SATA (R10) Global Data Warehouse BCV/Clone BCV/Clone BACKUP Copy Perf FC, SATA (R5) FC, SATA R(10) GOLD Copy SATA (R5) TEST BCV/Clone SATA (R5) EMC Symmetrix V-MAX 512 GB Cache 400 GB Flash Drives 300 GB - 15K RPM Fibre Drives 1 TB - 7200 RPM SATA Drives DEV SATA (R5)
EDL Flash Drives – Objects with most stringent response time Fibre Drives – Objects from current & recent few quarters SATA Drives – Historical data EMC IT - BI Grid DB - Environment Architecture Primary Site Secondary Site Production DR Dynamic SRDF 2 TB / Hr Flash Fibre Fibre Fibre SATA SATA RMAN Backup Host BCV/Clone 7 am BCV/Clone 7 pm Backup Copy Gold Copy DB Subset Host Performance Fibre Fibre Fibre SATA SATA SATA BCV / Clone BCV/Clone Development Test BCV / Clone SATA SATA Oracle 11g RAC, ASM & RDBMS
BI Grid Production Stats – NRT After Before Min Min • Highlights • 67% reduction on Incremental NRT Batch (56 min), improvement of nearly 2 hours • Near 62% reduction in processing time for OIC Batch • 58% reduction on average in processing time for PAS Procedures, some as high as 87%
Findings Delivery • Existing tool set (Brio) was old technology sunsetted by Oracle • EMC culture of bottoms up “roll your own” reporting • No support for dashboarding, KPIs, advanced visualization • Aging infrastructure unable to scale to meet growth of EMC Data Quality • Multiple data warehouses with embedded business rules • Business rules embedded in reports • No enterprise approach for management of key data assets • No sense of ownership for upstream data quality Governance • Limited cross functional awareness of BI initiatives • No cross functional prioritization of initiatives • No cross functional collaboration on delivery • Multiple hardware and DB environments hosting same data • Multiple teams supporting redundant data sets & reports • Multiple points of reconciliation consuming IT and Business resources • No tiering or archiving strategy TCO
Scorecard C D B A+
BI Replatform: Performance Highlights • Overall Job runtime reduced by 2.5 hrs • SMF MV’s completes 45 min earlier • BookBill report finishes 3 hrs earlier than old production • CCA batch takes 50% of original time, from 3 hrs to 1.5 hrs • 78% improvement in OBI Dashboard rendering and 74% improvement in OBI Drill down performance IDW • NRT REV Batch and NRT OIC Batch jobs gained approximately 2 hrs • NRT PAS Batch shows improvement of 58% on average across the individual jobs • NRT Book Bill Report delivered 3.5 hrs earlier and NRT Sales Rev Report delivered 3 hrs earlier than old production • Channels Data Mart now updates in half the original time NRT Essbase • SMF Essbase Cube build improved by 1.5 hrs, from 2 hrs to 30 min • Farm cube update down to 9 min from 3 hrs