1 / 28

Presentation Outline

AMRC Meteorological Data Distribution System Part II: Data Services Antarctic Meteorological Research Center (AMRC), Space Science and Engineering Center (SSEC) , University of Wisconsin-Madison, Madison, WI Zach Uttech, Matthew Lazzara, K. Elena Willmot and Linda M Keller.

janet
Download Presentation

Presentation Outline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AMRC Meteorological Data Distribution System Part II: Data ServicesAntarctic Meteorological Research Center (AMRC), Space Science and Engineering Center (SSEC), University of Wisconsin-Madison, Madison, WIZach Uttech, Matthew Lazzara, K. Elena Willmot and Linda M Keller

  2. Presentation Outline • Overview of AMRC • Goals of AMRC and efforts to improve efficiency of data distribution • New AMRC Website • Improved organization • User friendly • Current Data Services • Future Data Services • Summary

  3. Overview of AMRC • AMRC aims to provide real-time and archived data and observations to the public • Multiple data sources • Observational data • NWP data • Old methods of data distribution • FTP (File Transfer Protocol) site • Old website • A new method of data distribution • Developing a new website portal • Improved organization • Increased efficiency • And more

  4. New AMRC Website • Commonly used information • AWS Network tab • Data & Imagery tab • Recent news posted

  5. AWS Network Tab Dynamic (click-able) AWS Map • AMRC project distributes data for ~63 AWS stations • Serves as an accessible central location for archived AWS data Sidebar • Contains supporting AWS information

  6. AWS Network Tab • Dynamic (click-able) AWS Map • How to select an individual AWS • Beneficial feature • Simultaneous access to data of selected AWS and the dynamic map • Zooming and panning capabilities

  7. AWS Network Tab • AWS Ferrell Station Selection Example • General layout • Metdata data loads next to picture • Additional data will be organized into tables • Compress region and station lists into pull-down tabs

  8. AWS Network Tab • Sidebar • What makes up an AWS? • AWS diagram • AWS Maps • Data Books/Field Reports

  9. Data & Imagery Tab AMRC’s Archived Data (FTP site and more)

  10. Data & Imagery Tab IR WV • Satellite Imagery and Composite Thumbnail • Constructed from geostationary and polar orbiting satellites • Examples • IR, WV, pseudo color, hourly animations

  11. Data & Imagery Tab 500mb Heights MSLP • Models and Forecasts Thumbnail • Computer model data (ECMWF and GFS) overlayed with IR and WV composites (new!) • Mid-level data heights, RH, and VV • Surface data isobars, isotherms, streamlines

  12. Data & Imagery Tab • Data Fusion Thumbnail • Composite Animations • Satellite derived motion vectors • Ice concentrations • Control speed, zoom, and refresh image • Additional composites • SST with IR • Aqua and Terra motion vectors Satellite Derived Motion Vectors Ice Concentrations

  13. Data & Imagery Tab • Antarctic Surface Observations • Current and archived data • Upper-Air Observations • Recent and archived • Radiosonde data, Skew-t diagrams, and hodographs • Aircraft Observations • Current meteorological aircraft reports • Satellite Navigations • American and international polar orbiting satellite tracks • USAP Stations • Historical surface observation database • South Pole, McMurdo, and Palmer • AMRC’s Archived Data • Ftp site and more

  14. Current Data Services • 5 Data Services • FTP server • Stores archival data with minimal real-time datasets • Won’t be eliminated… • Rsync Service • Updates requested data automatically; saves user timer • Antarctic-IDD (Internet Data Distribution) Local Data Manager • Data sharing network based on Unidata’s LDM software • Focus on real-time data • Abstract Data Distribution Environment (ADDE) • Contains both real-time and archived data • E-mail distribution • Everything we have can be distributed via email • Goal provide self-serviceable data to reduce the effort to fill data requests!

  15. Antarctic-IDD (Internet Data Distribution)

  16. ADDE (Abstract Data Distribution Environment) AMRC.SSEC.WISC.EDU AWS.SSEC.WISC.EDU • ADDE Group AWS • All Real-time datasets • Examples • Hourly composites • AWS • Model output • Satellite winds • More • ADDE Group ARCHIVE • All ADDE ready archive data • ADDE Group AMRC • All Real-time datasets • Examples • Three hourly composites • AWS • Model output • More • Becoming obsolete • ADDE Group ARCHIVE • Will be discontinued

  17. Future Data Services • RAMADDA (Repository for Archiving, Managing and Accessing Diverse Data) • Hierarchical collection of folders and entries (accessed by public via URL) • Primary advantages • Store any data type • Make data easily accessible to users • Built by NSF funded Unidata Program

  18. Future Data Services • RAMADDA (Repository for Archiving, Managing and Accessing Diverse Data) • Testing capabilities as an experimental effort • Easy to load and manage new/old data entries • Long-term goal • Most of AMRC’s archived data ingested into RAMADDA

  19. Future Data Services • RAMADDA • Layout • Add descriptions about a data entry and the time range it covers • Data type examples • xls file – Mt Flem and Capte H • r file – Pegasus • txt file – FTP • McIDAS Area File • URL’s • View Tab • Allows for instant visualization of data • Animations and McIDAS area files Graph View

  20. Future Data Services • GIS (Geographic Information Systems) software and extensions used for AMRC products • ArcGIS • PostGIS • PostgreSQL • ZigGIS • QuantumGIS

  21. Future Data Services ArcGIS ZigGIS PostGIS • Definitions for GIS Software and Extensions • GIS computer system capable of capturing, storing, analyzing, and displaying georeferenced information • ArcGIS suite of GIS software products produced by the Environmental Systems Research Inst (ESRI) • QuantumGIS (QGIS) and ArcGIS interact with PostGIS-enabled databases for data management, visualization, and cartographic mapping • ZigGIS provides access specifically to PostGIS databases (extension)

  22. Future Data Services • Definitions for GIS Software and Extensions • PostgreSQL powerful, open-source, relational database system • Accessed by users indirectly through an external application rather than by application programming stored within the database (back-end database) • PostGIS spatially enables the PostgreSQL server • Open source add-on, gives PostgreSQL the ability to store and manipulate spatial data used in GIS and Mapping

  23. Future Data Services • Applications of the GIS software • We use PostgreSQL, PostGIS, and ZigGISto • Add tables which contain data that is not spatially referenced • Create a database that updates the AWS network map in real-time

  24. Future Data Services • Applications of the GIS software • We use ArcGIS and qGIS in day to day work • Beginning to manage information about the ~120 (AMRC + International) active Antarctic AWS using PostGIS • Using the zigGIS (extension to ArcGIS) to • Generate maps of AWS directly from the database • Map any station-related (non-spatial) data through relation joins in the database

  25. Future Data Services • Applications of the GIS software • Server applications such as Geoserver and Mapserver can generate web mapping/feature services from the same PostGIS-enabled database • Allows us to • Build near real-time web mapping interfaces that access the most current data automatically (from the PostGIS database) • Develop a PHP 5/Apache web interface to allow group editing/management of dataabout the AWS network (in the PostGIS database)

  26. Summary • Current data services • Antarctic-IDD • Continue to expand the number of participants in the network • ADDE • AMRC group has more capabilities than AWS server • AWS group becoming obsolete • Future data services • New AMRC website • Dynamic AWS map • Satellite composite and meteorological variable (NWP) overlays (new) • Improved organization over old website • GIS software/extensions • Update AWS network in real-time • Allow for group editing

  27. Acknowledgements Thanks to the Office of Polar Programs at the National Science Foundation grant No ANT-0838834 for its support of the AMRC project The authors also wish to thank SSEC and AMRC members for their contributions to the new AMRC website

  28. References Lazzara, MA, G Langbauer, KW Manning, R Redinger, MW Seefeldt, R Vehorn, and T Yoksas, 2006 Antarctic Internet Data Distribution (Antarctic-IDD) System 22nd International Conference on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology Atlanta, GA American Meteorological Society Seefeldt, MW, T Yoksas, and MA Lazzara, 2009a Real-time and archived Antarctic meteorological data via a synergy of interactive processing tools Antarctic Meteorological Observing Modeling and Forecasting Workshop 14-15 July 2009 Charleston, SC Seefeldt, MW, T Yoksas, and MA Lazzara, 2009b The distribution, retrieval, and visualization of real-time Antarctic numerical weather prediction, satellite and observational data 10th Conference on Polar Meteorology and Oceanography, May 18-21, 2009 Madison, WI Yoksas, T, J Caron, J McWhirter, M Richards, M Seefeldt, KW Manning, JG Powers, D Steinhoff, and MA Lazzara, 2009 Using Unidata’s RAMADDA and THREDDS Services to Support Two Disparate Projects AGU 2009 Joint Assembly The Meeting of the Americas, May 24-27, 2009, Toronto, ON, Canada www.postgis.org www.postgresql.org www.qgis.org www.unidataucar.edu/software/ramadda

More Related