150 likes | 378 Views
The Air Quality Data Exchange (AQDE). An exciting new project and what it means to the AIRNow Program. AQDE – What is it?. Air Quality Data Exchange pilot New Jersey, New York, Delaware partnership
E N D
The Air Quality Data Exchange (AQDE) An exciting new project and what it means to the AIRNow Program
AQDE – What is it? • Air Quality Data Exchange pilot • New Jersey, New York, Delaware partnership • Designed to allow free flow of real-time air quality information, both state-to-state and state-to-AIRNow • Uses standardized schema and EPA’s National Environmental Information Exchange Network (NEIEN) and Central Data Exchange (CDX)
Acronym Frenzy… • XML – eXtensible Markup Language • Human and machine readable standardized language for transferring data • NEIEN – National Environmental Information Exchange Network • A sort of “intranet” designed to exchange data between EPA and its partners • CDX – Central Data Exchange • EPA’s “node” on the NEIEN
The basic idea behind NEIEN and CDX • An analogy: • Credit cards • All cards have a magnetic strip with an agreed-upon “schema” for storing your info • Stores grab that info with card readers • It all works because the standards are used by everyone in the industry, plus almost every store plugs into the credit card processing network
The basic idea behind NEIEN and CDX • NEIEN is EPA’s data exchange network • To join, you must meet the standards for configuration and pass data with an approved schema • CDX is EPA’s “loading dock”, where data can be dropped off, or loaded onto, the network
Why? • Eliminates custom data flows and formats between States and EPA • Provides immense opportunities for automation • Allows data sharing between States and with any entity that is on the network • Standardizes the approach
AQDE and AIRNow • AQDE began as a pilot to share data between NJ, NY, and DE; and to share with EPA via CDX • The AQS system was the target, so their XML schema was chosen • AQDE contacted AIRNow about using that same schema to deliver to AIRNow • We piloted this approach last summer
AQDE and AIRNow • STI reviewed the AQS schema and adopted necessary elements to allow for real-time transfers • STI set up a node on the NEIEN • A pilot transfer was completed
Sounds simple. It is! • It’s a simple concept with far-reaching implications: • Same schema for AQS and AIRNow • Non-proprietary alternative to OBS files, XML based for maximum portability • By utilizing CDX positions AIRNow to use the same delivery mechanism as any other EPA data flow.
A few remaining issues • AIRNow and AQS • The XML schema makes integration possible, but with different levels of QA; different regulatory requirements; how do we integrate the two, if we do? • AIRNow Production Node • Currently supporting the AQDE pilot, money is in place to move to national production, but what will that mean?
A few remaining issues • Transition • We can’t stop supporting the old FTP and OBS file method overnight • Funding • Will these save States money, or cost them? • Will it raise the O&M costs for AIRNow?
A few remaining issues, but a ton of promise • At the DMC • Allows for automation of submission and auto-recovery when file transfer fails. • Data submission via node has recovery mechanism built in. The success or failure of submission can be detected and system can be programmed to automatically resend. • AIRNow system can query state or agency nodes for backfill data. • Allows states to update and backfill data in AIRNow database • States can update AIRNow with QC’d data (before they may submit to AQS) and/or backfill missing data. This can be automated. • Allows AIRNow system to easily recover after any period of downtime. AIRNow would query state systems for backfill data and would not require state staff time. This can be automated.
A few remaining issues, but a ton of promise • For equipment and software vendors • Provides a single schema and transfer mechanism that can be integrated into data acquisition platforms • For AIRNow partners • Allows for sharing of data between partners, without necessarily going through the DMC, e.g. AQDE
Next Steps • Bring AIRNow node to production • Market and test this new service outside of the AQDE pilot states • Market the schema to equipment vendors • Begin to explore how this may lead to interconnections between AQS and AIRNow