1 / 42

CDX and the Exchange Network

CDX and the Exchange Network. www.epa.gov/cdx. Connie Dwyer Environmental Protection Agency March 6, 2007. Topics. Background and Status Interoperability Specifications and Guidance Exchange Network Design Guidance SOA Service Ongoing and Future Work Questions. Background and Status.

oscar-cameron
Download Presentation

CDX and the Exchange Network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CDX and the Exchange Network www.epa.gov/cdx Connie Dwyer Environmental Protection Agency March 6, 2007

  2. Topics • Background and Status • Interoperability • Specifications and Guidance • Exchange Network Design Guidance • SOA Service • Ongoing and Future Work • Questions

  3. Background and Status

  4. CDX and the Exchange Network • The Exchange Network (Network) • promotes secure, standards-based information sharing and electronic data exchanges • The Central Data Exchange (CDX) • is the EPA exchange point (node) on the Exchange Network • provides common support services for the exchange of environmental data (shared services)

  5. What is the Exchange Network? An Internet and standards-based method for exchanging environmental information between partners • Key Components • Data Standards • Nodes • XML Schema/Registry • Trading Partner Agreements • Grant Program

  6. Exchange Network • Objectives • Promote better environmental decisions through improved data quality and data access • Provide a common method for automating, publishing and exchanging data among states, tribes, and EPA • Promote efficient business processes and standard technologies to reduce operational costs

  7. CDX / Exchange Network SOA • Based on a Service Oriented Architecture • Security Services • Discovery Services (UDDI) • Data Service • Publishing • Exchange • Transformation • Quality Assurance Services • Reduces Cost with Shared Services • Uses a Well-Tested Specification for Interoperability • Minimizes the Burden on Consumers • Universal Clients • Software Developer Kits • Open Source Implementations

  8. Program Silo 1 Registries Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Program Information Consumers Program Silo 2 Registries Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Program Silo 3 Registries Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Program Silo 4 Registries Program Data Repositories & Data Warehouses Policy Makers Industry Analysis and Access Systems Front End Data Collection Systems Program Information Consumers Program Silo 5 Unmanageable Complexity >150 data flows 1000’s of reports Dozens formats/ models Registries Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Program Information Consumers States Program Silo 6 Registries Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Legislators Program Silo 9 Registries Local Govt Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Program Information Consumers Program Silo 7 Registries Program Silo 10 Registries Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Program Information Consumers Front End Data Collection Systems Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Silo 8 Universities Registries Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Citizens Program Silo 19 Registries Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Program Information Consumers Tribes Program Silo 15 Program Silo 14 Program Silo 18 Program Silo 13 Program Silo 12 Program Silo 16 Program Silo 17 Registries Registries Registries Registries Registries Registries Registries Program Data Repositories & Data Warehouses Program Data Repositories & Data Warehouses Front End Data Collection Systems Program Data Repositories & Data Warehouses Program Data Repositories & Data Warehouses Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Analysis and Access Systems Front End Data Collection Systems Front End Data Collection Systems Front End Data Collection Systems Front End Data Collection Systems Program Data Repositories & Data Warehouses Analysis and Access Systems Analysis and Access Systems Analysis and Access Systems Analysis and Access Systems Front End Data Collection Systems Program Data Repositories & Data Warehouses Analysis and Access Systems Program Information Consumers Program Information Consumers Program Information Consumers Program Information Consumers Program Information Consumers Program Information Consumers Program Information Consumers Program Silo 11 Registries Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Program Silo 20 Registries Program Data Repositories & Data Warehouses Analysis and Access Systems Front End Data Collection Systems Program Information Consumers Program Silo 50+ Registries Program Data Repositories & Data Warehouses Front End Data Collection Systems Analysis and Access Systems Program Information Consumers Problem Solved by CDX / the Exchange Network

  9. In Development Operational Not Yet Started Status of State Nodes - January 2007 WA MT ME VT ND OR OR MN NH NH ID WI SD NY MA AK MI WY RI CT IA PA PA NE NJ NV OH IN IL UT DE CO MD WV WV CA VA KS DC MO KY NC TN OK AZ NM NM NM SC AR HI GA AL MS MS TX LA FL FL

  10. State-to-EPA Facility Data to FRS Drinking Water Data to SDWIS Haz Waste Data to RCRAInfo Air Emissions Data to NEI Air Quality Data to AQS EPA-to-State TRI Data Submissions Substance and Chemical Data Facility Data from FRS Air Quality Data - Coming Soon Types of Data Network Exchanges State-to-State • Water Quality Data • Hazardous Waste Transporters • Air Quality Data – Coming Soon • Homeland Security Data • Intrastate • Environmental Data to Health Departments • Drinking Water Labs to States • Homeland Security/Law Enforcement Data • County Water Data

  11. CDX & Exchange Network Partners Internet General Public State Partners California Air Resource Board Indiana EMITS Industry Partners Water Utilities & Power Plants Chemical Producers Automobile Manufacturers EPA Program Office Partner Systems Oil Refineries Tribal Partners TRI RMP SRS FRS RCRAInfo EnviroFlash AIRNow AQS BMS/ACRES Eastern Band of Cherokees St. Regis Mohawk NEI ODS RADNESHAPS ICTS Yurok NOI eIUR IGMS SDWIS LT2 Wind River VERIFY OTAQ WQX/STORET TSCA RADNET EAB PCS Pay.gov Grants.gov EPA Regional Partners Central Data Exchange Web Forms Web Services eGov Initiative Partners Region 4 - CAFO Data Quality Services Security Services E-Authentication Federation Region 5 - GeoExchange Help Desk & Operations Support Hosted & Distributed Integration Services

  12. Help Desk Registry Etc. Network Governance Exchange Network Leadership Council (ENLC) Policy/ Strategic Planning Executive Coordinator Network Operations Board (NOB) Operations Oversight Network Partnership and Network Policy and Network Technical Group (NTG)* Network Technical Group (NTG)* Standards Teams* Standards Teams* Resources Group (NPRG)* Resources Group (NPRG)* Day to Day Operational and Day to Day Operational and Standards Design and Standards Design and Day to Day Policy and Day to Day Policy and Technical Support Technical Support Development Development Resource Activities Resource Activities Help Desk Help Desk Registry Registry Etc. Etc. *Example Sub *Example Sub - - Groups Groups

  13. Interoperability

  14. Interoperability Levels XML Schemas - Data Interoperability SOAP – Message Interoperability WSDL – Web Service Interoperability DIME(MTOM) – Attachment Interoperability

  15. Interoperability Components • Data Standards • XML Design Rules and Conventions • XML Schema Review Process • W3C Web Service Standards • Network Specifications • Reference Implementations • Interoperability Testing • Interoperability Test Tools • QA Services

  16. Service Interoperability Guidelines • Promote interoperability through the use of Open Standards • Incorporate Web Service Standards with Maximum Acceptance and Strongest Tool Support *Services are currently hosted / interoperate on every major application platform

  17. CDX / Exchange Network Technology • SOAP v1.1 (1.2): Simple Object Access Protocol • WSDL v1.1: Web Services Description Language • UDDI v3: Universal Description, Discovery and Integration • W3C XML-Encryption • W3C XML-Signature • SAML v1.1: Security Assertion Markup Language • WS-Security v1.0 • XKMS v2.0: XML Key Management Specification • DIME – Direct Internet Message Encapsulation • (MTOM) – Message Transmission Optimization Mechanism • BPEL 1.1 – Business Process Execution Language • Exchange Network Protocol and Specification

  18. Specifications and Guidance

  19. Design Specifications • Network Node Functional Specification describes • Actions performed by the node • How node functions are invoked • Expected node output • Network Node Exchange Protocol defines • Types of valid messages a node should receive • The format for sending messages among nodes • These specifications ensure interoperability across platforms by clearly defining the process and expected behaviors

  20. Design Specifications / Guidance • Network Authentication and Authorization Specification • Network Security Guidelines and Recommendations • Flow Configuration Documents – Business rules for conducting dataflow using network nodes • DET/XML Schema Guidelines • See WWW.EXCHANGENETWORK.NET

  21. Exchange Network Guidance • DATA EXCHANGE DESIGN BEST PRACTICES • Best Practices for Schema Design • Best Practices for Handling Large Transactions • Best Practices for Managing State • Best Practices for Data Services • Best Practices for Data Validation • DATA EXCHANGE MODELS • The Data Synchronization Model • The Data Publishing Model • Patterns in Authentication and Authorization • Patterns in Requesting Data • Patterns in Submitting Data • Other Data Exchange Scenarios

  22. XML Guidance • The Core Reference Model contains major groupings of environmental data and their relationships in order to assist the development of Data Exchange Templates (such as XML schema), data standard development, and the creation of Shared Schema Components. • Shared Schema Components (SSC) - sharable schema components based on approved EDSC data standards and detailed guidance to XML schema developers on how they can incorporate the SSC into their XML schema.

  23. XML Schema Development and Management Process Start Here

  24. SOA Services

  25. How Are Services Being Used? • Authenticate a User • Authorize an Activity • PKI Management • Quality Assurance • Data Transformation • Submit Information to a Partner • Status Notification • Find a Web Service • Publish Information • Query Information

  26. Security Architecture / Services

  27. Network Authentication and Authorization Security Services • PKI related services – support CBI activities • XML Key Management Services (XKMS) Public Key Management • Allows users to locate, publish, and validate public keys • Network Certificate Authority • Issues and manages certificates used for secure socket layer (SSL) transactions over the EN • Certificate Validation • Provides general signature/encryption validation • Provides certificate revocation checking against eAuthentication Federation • Custom API interface to MitreTek Certificate Arbitration Module (CAM)

  28. Discovery Services • Universal Description, Discovery and Integration (UDDI) registry service for cataloging and publishing Agency services • UDDI registry service manages information on: • Service providers • Service implementations • Service metadata • Advertise services • Discover services • Interfaces • Browser • Web services https://uddi.epacdxnode.net/uddi/bsc/web

  29. Quality Assurance Services Web Service-based XML document validation • XML Schema Validation • Extended business rules validation Uses Schematron technology Empower Data Stewards to Manage Data Quality

  30. Lessons Learned • Develop an XML Management Approach Early • Use W3C Standards Where Possible • Use a Coarse Grained Service Model • Provide Tools to Simplify Adoption • Deliver Shared Services for Common Functions

  31. Ongoing / Future Work

  32. Make It Faster and Easier! • Node 2.0 • Node Client • Network Browser • Discovery Services • Dynamic Publisher

  33. Network Node 2.0 Specification • Integrating the latest technologies. • MTOM Message Transmission Optimization Protocol • Relevant WS specifications • Parallel support for existing and new specification for a smooth transition. • Creating a complete turn key solution on major platforms - .NET and JAVA-Open Source

  34. Node Client 2006 – Wizard driven access to All Network Services XKMS XML Signature and Encryption

  35. Network Browser– Browse Meta Data and Query Any Network Data Services

  36. Discovery Services What can I do with it? • Embed within an application • Surf with a browser • Use in a PDA/Smart Phone

  37. Simplified Data Service Publishing Empower Data Stewards to Publish their Data

  38. Keys to Success • Standards • Specifications • Shared Services • Exchange Agreements • Exchange Templates • Governance • Communications and Outreach • Strong Partnerships

  39. Questions / Comments ?

  40. For More Information Connie Dwyer EPA Office of Environmental Information (202) 566-1691 Dwyer.connie@epa.gov www.exchangenetwork.net www.epa.gov/cdx

More Related