280 likes | 292 Views
Data for Environmental Modeling: Background and Example Applications. Kurt L. Wolfe, Rajbir S. Parmar, Gerard F. Laniak, Aaron B. Parks, Laura Wilson, Jo Ellen Brandmeyer,Daniel P. Ames, Mark H. Gray.
E N D
Data for Environmental Modeling: Background and Example Applications Kurt L. Wolfe, Rajbir S. Parmar, Gerard F. Laniak, Aaron B. Parks, Laura Wilson, Jo Ellen Brandmeyer,Daniel P. Ames, Mark H. Gray United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Overview • Motivation for D4EM • Software evolution • Description of software • The Future United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
3MRA • Multi-media, Multi-receptor, Multi-pathway Risk Assessment • Monte Carlo simulation modeling chemical source release, multimedia fate and transport, foodwebs, exposure, and health effects on people and ecosystems • Extensive manual data collection done to populate database for model parameters • Currently simulations can only be performed at the national scale • Moving towards site specific application United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Conceptual Multimedia Model United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
3MRA Science Modules Data Flow United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Data access issues for 3MRA site specific inputs • Heterogeneous data sources • USGS, EPA, NOAA • Heterogeneous data types • jpeg, text, GeoTIFF, xml, netCDF • Multiple geographic projections • UTM, Geographic • Multiple access protocols • SOAP, WMS, OPeNDAP, ftp, HTTP screen scraping United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
D4EM – Data for Environmental Modeling • Provide a mechanism for accessing heterogeneous data • Abstract complexity of data access and conversion from model user • Reusable, extensible component based architecture • Automate common tasks • Public domain software written with .Net framework United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Possible Alternatives – Data Warehouse • Aggregate data into environmental data warehouse • Advantages • Control of data • Single point of contact – easy to maintain, enhance • Searchable directory • Uniform data access and distribution • Disadvantages • Maintenance costs associated with collecting and serving data • Keeping data fresh • Scalable? • For example the U.S. Army Corp of Engineer’s DataNet http://www.erdc.usace.army.mil/pls/erdcpub/docs/erdc/images/DataNet_fact_sheet.pdf United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Alternative 2 - Client based components • Client based components that act as a gateway to data providers • Advantages • Scaling not an issue • No server maintenance costs • Only connect with desired data providers • Data not stale • Easy for community to enhance/extend • Disadvantages • No single point of contact for bug fixes/updates United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
D4EM Sequence Diagram - AOI United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
USGS HUC boundaries Accounting unit Cataloging unit Dam sites EPA regional boundaries State boundaries County boundaries Federal and Indian lands Ecoregions Legacy STORET Planned STATSGO NHDPlus Modernized STORET EDDT Data Sources • Terra Server (Bounding Box) • DOQ • DRG • Urban • NWIS (Bounding Box, HUC8, HUC2) • NLCD (Bounding Box) • BASINS (HUC8 except base maps) • Land use/land cover • Urbanized areas • Populated place locations • Reach File version 1 (RF1) • Elevation (DEM) • National Elevation Dataset (NED) • Major roads United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Environmental Data Download Tool (EDDT) • EDDT is the lowest level component in D4EM stack • Manages the IEnvironmentalDataProvider components • Allows for local data caching United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
IEnvironmentalDataProvider Interface • ID uniquely identifies Data Provider e.g. gov.epa.eddt.terraserver • QuerySchema – return XML doc describing component calling methods • Execute – initiates data retrieval process United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Example – Return from TerraServer QuerySchema United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Data Manager • Provides interface between Use Cases and EDDT • Translates data request from general parameter names to data source-specific parameters • Projects spatial data to requested projection • Clips spatial data as requested • Converts data from units in data source to units requested by Use Case • Augments metadata with information on all data processing United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Specifying Area of Interest (AOI) United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Specify chemical contaminants Converting the 3MRA chemical properties database into a web service United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Future Work • Continue to work with open source community to enhance D4EM functionality • Increase the number data sources for which D4EM can provide access • Enable ‘intelligent’ data retrieval through enhanced meta data querying in Data Manager • Application of D4EM to regional ecosystems services assessment United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
D4EM Core Team • U.S. EPA • Gerry Laniak, Rajbir Parmar, Kurt Wolfe • RTI International • Jo Ellen Brandmeyer, Steve Beaulieu, Robert Truesdale, Linda Andrews, Jay Rineer, Laura Wilson, Aaron Parks, Sunil Rao • AquaTerra • Jack Kittle, Mark Gray • Idaho State University • Daniel Ames and graduate students • CSC • Mike Galvin, Ron Beloin Although this work has been reviewed by EPA and approved for presentation it may not necessarily reflect official agency policy. United States Environmental Protection AgencyOffice of Research and Development | National Exposure Research Lab, Ecosystems Research Division
Convergence • Models that require large amounts of data • Sensors, models, and databases that produce vast quantities of data • Internet makes it possible to move data efficiently • Emergence of standards • Representing data – XML, GML • Moving data - Web services, OGC standards