340 likes | 357 Views
Learn about the Exchange Network, CDX services, and how to set up and use them for automated data exchange, reducing reporting burden and improving data quality. Explore Network nodes, web services, data exchanges, and key components.
E N D
Using CDX and the Exchange Network Services 2007 STORET/WQX ConferenceAustin, TX November 28 Roy Chaudet US Environmental Protection Agency Office of Environmental Information
Topics • What is the Exchange Network? • Network Nodes and Web Services • What is CDX? • Services you use with WQX • Setting Up and Using Services • Questions
Topics • What is the Exchange Network? • Network Nodes and Web Services • What is CDX? • Services you use with WQX • Setting Up and Using Services • Questions
What is the Exchange Network? An Internet and standards-based method for exchanging environmental information between partners • Key Components • Data Standards and Standard Protocols • Nodes • XML Schema/Registry • Trading Partner Agreements • Grant Program
Purpose of Network • Supports automated exchange of data • Enables timely and accurate exchange • Reduces reporting burden • Improves data quality
State-to-EPA Facility Data to FRS Water Quality Data to WQX Drinking Water Data to SDWIS Haz Waste Data to RCRAInfo Air Emissions Data to NEI Air Quality Data to AQS EPA-to-State TRI Data Submissions Substance and Chemical Data Facility Data from FRS Air Quality Data Types of Data Exchanges on the Network State-to-State • Water Quality Data • Hazardous Waste Transporters • Air Quality Data • Homeland Security Data • Intrastate • Environmental Data to Health Departments • Drinking Water Labs to States • Homeland Security/Law Enforcement Data • County Water Data
Status of State Nodes October 2007 Many States/Tribes have Nodes You can exchange WQX Data through these Nodes!
Topics • What is the Exchange Network? • Network Nodes and Web Services • What is CDX? • Services you use with WQX • Setting Up and Using Services • Questions
What is a Network Node? “A simple environmental information Web service that initiates requests for information, processes authorized queries, and sends/receives the requested information in a standard format.” • Is a Server accessible on the Web • Complies with the protocols to ensure secure exchanges • Sends and receives standards-based messages • Returns requested information as XML • Each partner has only one Node
Node Client Applications • Simplify access to services on full Network Nodes • Cannot listen (and respond) to requests from other nodes • Human-to-Machine interaction • Easy to install and use • Available in .NET and JAVA versions • Node Client Software Developer Kit (SDK) - simplifies integrating Node client functions (web service calls) with just a few lines of script
Web Service • Definition: Information sources/application components whose functionality and interfaces are exposed to consumers using standard messaging protocols including: • Extensible Markup Language (XML) for the payload or file, • Simple Object Access Protocol (SOAP) as a wrapper for the payload, • Web Services Description Language (WSDL) for network exchange functions and services, and • Hypertext Transfer Protocol (HTTP) for secure communication via the internet Basically: A machine readable Email message
Topics • What is the Exchange Network? • Network Nodes and Web Services • What is CDX? • Services you use with WQX • Setting Up and Using Services • Questions
What is CDX? • The Central Data Exchange (CDX) is the central point through which environmental data enters the Agency • EPA’s Node on the Environmental Information Exchange Network (Inflows and Outflows of Data to Partners)
CDX Exchange Mechanisms • CDX Web – EPA’s site for submitting environmental information via standard Web browsers • Users submit data via Web-based forms and file uploads (flat file, XML file) • Users receive submission confirmation/processing reports • CDX Node – EPA’s Web services infrastructure on the Exchange Network • Supports machine-to-machine data exchanges • Standardized Web service protocols and XML schemas used
Archive Data What Functions Does CDX Provide? PC & Internet Browser • User registration • Authentication • Enhanced Security • Translation • Data validation Translate or Edit Receive Submit Web Services Validate Distribute EPA & Other Systems Submit XML, Binary or Flat-File • Data publishing • Archiving • Distribution • Messaging services • Customer support
CDX Services CDC HHS E-Auth Certificate Authorities Pay.Gov • Registers users • Help Desk • Documentation • Official copy • Archives as needed • Transaction Log Service Gateway Quality of Service ECMS Business Process Automation Data Archive CDX Node EPA Systems CDX Lite Submit Web Forms CDX Web Content Translation or Validation Signature/ Encryption Processing Distribution Submit XML, Binary, or Flat Files Authenticate & Authorize Receive • Capture and Log Submission Data • Audit trail • Provides receipt • Scan for viruses • Confirm Origin • of Submission • Digital signature • Encryption) • Translate and/or • Edit Data • Format Conversion • Performs simple or complex edit checks on files • Creates multiple / different copies • Provides copies of record to submitter • Distribute Data to • Target Systems • Uses “push” or “pull” technologies • Provides a variety of connections (e.g., VPN) • Sends return messages and error notifications to users at several points CDX Node • Identity/ Access Management Web Services NAAS Security Services Quality Assurance Services AGENCY Identity Management Services State Nodes
User Benefits of CDX • Responds to Industry/state/program desires for a common point of exchange with EPA • Provides common registration process for industry • Provides standard interface and formats for users • Integrates receipt, security, translation, archiving and distribution functions • Maintains centralized customer support
Topics • What is the Exchange Network? • Network Nodes and Web Services • What is CDX? • Services you use with WQX • Setting Up and Using Services • Questions
CDX/Exchange Network ServicesYou Use with WQX • Registration (Network) • Authentication and Authorization (NAAS) • Secure Document Exchanges • Data Reporting • Data Querying • Messaging (status, error) • Quality Assurance (validation) • Web Service Management (Monitor Services) • Internal Services: Archiving, Logging, Routing, Distributing, etc. Centralized, Shareable Web Service Components
CDX/Exchange Network ServicesYou Use with WQX 2.Authentication/ Authorization 3. Secure exchanges 4. Data reporting 5. Data querying 6. Validation 7. Messaging 8. Monitoring 9. Internal Services 1.Registration Node Account Setup 1.Registration Web Account setup
Topics • What is the Exchange Network? • Network Nodes and Web Services • What is CDX? • Services you use with WQX • Setting Up and Using Services • Questions
Network Desktop Setup 1 Obtain Node/ NAAS ID 2 Obtain WQX Organization ID 3 Download and install Network Desktop 4 Ready to Submit
Network Desktop Submission 1 Login 2 Authenticate 3 Submit 4 Get Status 5 Download report, correct errors, resubmit 6 Receive Success Status
Network Node Setup 1 Obtain Node/ NAAS ID 2 Obtain WQX Organization ID 3 Ready to Submit
Network Node Submission 1 Provide XML File to Submit to Node Administrator 2 Receive Error Report from Node Administrator, Correct Errors, Resubmit* 3 Receive Success Status from Node Administrator Talk to Your Node Administrator! *Node 2.0 can send e-mail status to user
Summary • Exchange Network and CDX have services being used by 50 states and 12 tribes • You can submit and query WQX data through the Exchange Network and CDX • Using a Full Network Node • Using a Network Desktop/ Node Client • In the future, you can • Generate an XML file using the XML Generation Tool and • Submit it via CDX web
Resources • EPA Exchange Network http://www.epa.gov/exchangenetwork • Exchange Network http://www.exchangenetwork.net http://www.exchangenetwork.net/node/ • CDX http://www.epa.gov/cdx/ • Node Help Desk • nodehelpdesk@csc.com • 1-(888)-890-1995 • WQX Help Desk • storet@epa.gov • 1-(800)-424-9067
States with Multiple Data Exchanges 3 4 5+ 1 2 WA ME MT ND VT MN OR NH MA ID WI NY SD RI WY MI CT PA NJ IA NE NV OH DE IN IL UT MD CO WV VA KS MO CA KY NC TN OK AZ NM AR SC GA AL MS TX LA AK FL HI