190 likes | 279 Views
Enterprise Information Services (EIS) - Review. Ray Chase Manager, EIS. EIS Vision. Provide reliable, innovative, centralized, and comprehensive decision support and business intelligence systems to ERCOT, the Market, and the PUCT. Why?.
E N D
Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS
EIS Vision Provide reliable, innovative, centralized, and comprehensive decision support and business intelligence systems to ERCOT, the Market, and the PUCT.
Why? • Protocol Requirements – Market Data Collection and Use (section 17) • Collect an Accurate Historical Record of all Source Systems • Intra-day Capture – All Data • Auditability • Single System Source Data Integration • Opportunity to Offset Source System Load • Robust Reporting Environment • Ease of Use • Centralized Tools • One Version of the Truth • Data Modeling • Oversight • Future ERCOT and Market Decision Support Opportunities
Overview • Data Collection • Data Archiving/Roll-off • Data Integration • Data Transparency and Delivery • SOA Framework • Data Modeling and Analysis • Business Intelligence and Reporting • Legacy System Transition • Current Project Relationships • Current Statistics
Siebel Paper Free Siebel Paper Free Lodestar lodstar Lodestar lodstar TCH Lodestar lodstar TCH TCR Lodestar lodstar EMMS omsappdev EMMS ercot RSS ODS EMMS his_user Data Collection • All Operational Source Systems feed into ODS • Replication is near real-time • All intra-day transactions • Nearly all tables (rules)
Source System RSS ODS Table_A Table_A Table_A Current Record Record Record Insert, Update, Update, Update Insert, Update, Update, Update Insert Insert Insert 200103 History Long-term Tape 200102 Record 200101 Record Record Data Archiving/Roll-off • Uses a table based, data partitioning strategy • Performance • Long-term Historical Data Archiving
Business Intelligence ODS Lodestar lodstar EMMS omsappdev TCR Collateral Calculation Data Integration • Multi-source system data integration • Removes fragmentation of solutions • Single version of the truth • Reusability • Various 2005 projects with integration • 50017 – Collateral Calc • 50130 – ESIID Lookup • 40015 – TCR Reporting • 50001 – BI Foundations
Business Intelligence CDW RSS ODS Data Transparency and Delivery • Single Design - Multiple Solutions • Large Scale Market Participant Extraction • Public Data Extraction • Market Reporting Tool (2006) • Web Service Delivered Data (50024 – SCR740, ESIID) • Type-1 – Scheduled Data Delivery • Type-2 – Real-time Data Delivery Portal Views Data Extracts Web Services Market Report Tool
MP System MP System URL HTML URL XML URL XML SOAPRequest SOAP Reply XSLT URL XML SOA Framework System to System utilizing our SOAP Web Services System to System utilizing our XML REST Web Services ERCOT’s Service Orientated Architecture Framework will provide four methods to access ERCOT’s information and services Use an ERCOT supplied Web Interface Build your own interface utilizing our XML REST Web Services ERCOT Service Orientated Architecture Framework www.amazon.com/gp/browse.html?node=3435361
Legacy PC PC PC Lodestar Business Logic MS Access MS Access MS Access .xls .xls .xls Business Intelligence .xls .xls .xls CDW EMMS .xls .xls .xls .xls .xls .xls PC PC PC … RSS ODS .xls .xls .xls .xls .xls .xls .xls .xls .xls .xls .xls .xls Current Data Modeling and Analysis • Provides a framework for decision support, business intelligence, and data modeling and analysis
Business Intelligence ODS Siebel Lodestar lodstar TCH PC PC EMMS omsappdev .xls .xls .xls .xls EMMS ercot .xls .xls EMMS his_user .xls .xls CDW PC .xls ETS Data Mart .xls Proposed .xls Data Modeling and Analysis • Data Warehouse Marts
Census PC PC Geographic .xls .xls .xls .xls Business Intelligence .xls .xls CDW Detailed Weather .xls .xls PC .xls RSS ODS .xls .xls Data Modeling and Analysis • Potential External Data Source Additions
In-Bound In-Bound Application Security Application Security Operational Data Store (ODS) API Conformed Data Warehouse (CDW) API API Ref Cursor API Ref Cursor Views Views Out-Bound Out-Bound Business Intelligence & Reporting • Centralized view foundation • Provides standardized querying of all data • Secure - Prevents direct access to the ODS database objects • Ensures all private data is protected by the ODS security layer
Business Intelligence & Reporting • Web-based tool for universal use Prompts provide a way quickly choosing your selection criteria B.I. tool allows “drilling-thru” to lower levels of granularity Extremely efficient for quickly & visually going from “10,000 foot” view to “extreme close-up”
EIS System Transition EIS Systems & Applications Data Transparency Web Service Based Data Delivery D D Extracts Data Delivery Module (DDM) T Real-Time Reporting Report Net Detailed Reporting Business Intelligence Foundation Summary Reporting Application Replication & Security Framework Source Systems Replicated Source Systems Operational Data Stores TCH TCH RSS TCH ODS D 6 6 Security Foundations Paperfree Paperfree RSS Paperfree ODS Conformed Data Warehouse (CDw) 6 6 Standard Views Standard APIs Siebel Siebel RSS Siebel ODS 6 6 TCR TCR ODS Custom Views Custom APIs & BLAPIs D 6 Data Mart EMMS EMMS RSS EMMS ODS Data Mart Application Administration Data Mart Lodestar Lodestar RSS Lodestar ODS ETS 6
2005 EIS Project 40015_02 Relationships TCR Report Enhancements 30084 CSC Thermal & Volt Limits 50004 Calculations / Posting EDW BI Reporting Tool 30105 50017 Congestion Management CO – Collateral Calculation Reports 50024 Enhancements to SCR727 P 40100 RTCA Archiving 50030 EDW Lodestar & EMMS Transition 50121_03 Market Information 40072 Distribution MPCE Correction 40042_06 EDW Standard LodeStar Extracts 40108 50005 40084 Disclosure of Local EDW EMMS Reports Outage Scheduler Congestion Enhancements P2 30026 P EPS Meter Data (RID) 40042_07 EDW EMMS ODS 40098 Performance Monitoring for SCADA / State Estimator 40007 P SCR 727 Phase II 50001_01 Ancillary Services 30183_01 R4 Project Rollover Stand-Alone Projects 50001_03 Replacement Reserves Market Ad Hoc Reporting 50007 50001_02 Enhancements to Fas Trak Price Spike Analysis Tools 50001_04 Ad Hoc Access to QSE 50002 Down-Balancing Compliance MOMS – Enhancements to 50023 Report Data MO - 40044 Potomac Software Potential Load Loss ADAM Integration 50003 50025 MO - 40104 MOMS – Enhancements to Enhance ESI ID Look-Up Zero Charge AREVA Study Tools Function Enhancements Current Project Relationships P P P P P P Legend Affected by Parsing P Project NOT Started Initiated Project MO Planning Project CO Executing Project SO Completed Project IO RO Cancelled or Deferred Project
Current ODS Statistics • Migration - ~2 billion historical transactions from Lodestar and EMMS • Replication – no lost information to date • Daily Average ~15 million transactions • Total transactions posted • Developed/Installed Code Base
Conclusion • Comments? • Questions? • Thank You!