1 / 35

Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project

Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University Shawn McClure. CIRA at a glance. Groups at CSU Foothills Campus

purity
Download Presentation

Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University Shawn McClure

  2. CIRA at a glance • Groups at CSU Foothills Campus • Operates under a 5-year renewable Cooperative Agreement (CA) with NOAA • Complementary CAs with DoI/NPS and DoD/ARL • 146 scientists, staff and students • Including 6 Federal NESDIS scientists/4 Federal NPS Scientists • Including 7 post docs, 21 graduate students, 16 undergraduates • Including 14 academic faculty (part time) • ------------------------------------------------------------------------ • $13M/year in research and outreach funding • $8M/year from NOAA

  3. CIRA Sponsors

  4. Groups, Partnerships, and Collaborations • Groups at CSU Foothills Campus • Cooperative Institute for Research in the Atmosphere (CIRA/CSU) • Colorado State University Atmospheric Sciences Department (Richard Johnson) • CSU Atmospheric Chemistry Department (Jeffrey Collett) • National Park Service (NPS) Air Quality Research Group (Bret Schichtel, Bill Malm) • NOAA/NESDIS Regional and Mesoscale Meteorology Branch (RAMMB, Mark DeMaria) • Center for Multiscale Modeling of Atmospheric Processes (CMMAP – NSF, Dave Randall) • Western Governor’s Association (WGA, Tom Moore) • Western Regional Air Partnership (WRAP, Tom Moore) • Other CIRA Partnerships and Collaborations • National Aeronautics and Space Administration (NASA) • Institute for the Environment at the University of North Carolina, Chapel Hill • Sonoma Technologies, Inc. • Air Resource Specialists, Inc. (ARS) • ENVIRON • Multiple Universities

  5. Systems, Projects, and Collaborations • Architects, Developers, and Operational Managers for: • The Visibility Information Exchange Web System (VIEWS): http://views.cira.colostate.edu • The WRAP Technical Support System (TSS): http://vista.cira.colostate.edu/tss • The Federal Environmental Database (FED): http://views.cira.colostate.edu/fed • The EPA Air Toxics Data Archive (ATDA): http://vista.cira.colostate.edu/atda • Principal Investigators for: • The NASA Satellite Data Extension to VIEWS/TSS (beta): http://views.cira.colostate.edu/nasa • The NAAPS Data Extension to VIEWS/TSS: http://views.cira.colostate.edu/web/projects/naaps.aspx • The EPA Ozone Data Pilot Project: http://views.cira.colostate.edu/web/projects/epaozone.aspx • Other Active Projects and Collaborations: • The Emissions and Air Quality Modeling Data Management System for the Southeastern States Air Resource Managers(SESARM): (URL pending) • Operational exemplar (VIEWS/TSS) for the Group on Earth Observations’ (GEO) Global Earth Observation System of Systems (GEOSS): (URL pending) • EPA’s Cyber-Infrastructure (CyAir) project: http://www.cyair.net/ • Development Consultation and Operational Hosting for: • The WRAP Emissions Data Management System: http://www.wrapedms.org • The WRAP Fire Emissions Tracking System: http://wrapfets.org

  6. VIEWS/TSS Data and Processing Flowchart

  7. Modeling Data and Processing Flowchart

  8. High-level Architecture of our System of Systems

  9. Database and Data Warehouse Management

  10. Data Import and Integration

  11. VIEWS/TSS Decision Support Tools

  12. VIEWS Website Traffic and Usage

  13. Data Management: Extracting and Filtering

  14. Data Management: Transforming and Reformatting

  15. Data Management: Structuring and Reconciling

  16. Data Management: Derived and Intermediate Products • Uniformly formatted netCDF files • Optimized for long term storage • More easily consumed by end users • Facilitates interoperability and standardization • Better enables derived product generation • Static graphical images • Can be used by a wide variety of visualization tools • Transparency of *.PNG images is ideal for Google and Bing Maps • Enables quick browsing and identification of air quality events • Enables smooth client-side animations and searching • KML and KMZ files • Makes it possible to store feature and topology data • Can be used by current and popular visualization tools • Enables direct data and metadata query • Facilitates sharing and interoperability

  17. Data Management: Standards and Interoperability • “Interoperability”: The ability of diverse systems and organizations to work together to exchange and utilize information. • To facilitate this, VIEWS has been designed with the following services and features: • Discovery, retrieval, and exchange of data and metadata • On-the-fly transformation and formatting of data and metadata • Upload and management of user-supplied data and metadata • Generation of visualization and analysis products • Availability of “embeddable” components and tools • Support of OGC web standards for spatial data exchange

  18. Interoperability: Enabling Systems of Systems

  19. VIEWS/TSS Decision Support Tools

  20. Metadata Exploration: Dataset Inventory

  21. Metadata Exploration: Monitoring Site Information

  22. Metadata Exploration: Air Quality Events • Exceptional event metadata (such as fires) can be stored and dynamically associated with data, photos, and imagery at run time in order to provide quick cross-referencing and discovery of related data. Thus, satellite and modeled data can be quickly associated with aerosol events once these linkages are complete. • “Bisquit” fire impacting Crater Lake in 2002

  23. Data Exploration: File Explorer tool

  24. Data Exploration: Aerosol Composition Analysis

  25. Data Exploration: Image Browser and Animation Tool

  26. Data Exploration: Dataset Timeline and Parameter Inventory

  27. Mapping: CAMx Ozone from CIRA – April 20, 2006

  28. Mapping: CMAQ Ozone from UNC – April 20, 2006

  29. Mapping: Aura/OMI Ozone Column – 4/20/2006

  30. Mapping: Aura/OMI RadiativeCloud Fraction

  31. Mapping: IMPROVE Ammonium Sulfate

  32. Mapping: Three layers combined

  33. Mapping: Google Earth

  34. Comments and Recommendations • Expect greater complexity (than you do right now) • Ensure that software engineers lead the Data Warehouse development (not scientists) • Leverage existing work (e.g. WestJump AQMS, WRAP work, etc.) • Modularize functional areas • Modeling • Data Warehouse • Configuration Management (versioning, lineage, pedigree, and change tracking) • End User Tools • Create a “data broker” position to manage data flows between functional areas • Buffer modelers and system developers from decisions about data • Organize an approach to disagreements • Don’t let the perfect become the enemy of the good • Plan for delays

  35. Thanks. VIEWS website: http://views.cira.colostate.edu TSS website: http://vista.cira.colostate.edu/tss Shawn McClure: mcclure@cira.colostate.edu

More Related