1 / 24

Open source visualisatie met ADAGUC

Learn about ADAGUC, an open source software for visualizing atmospheric data. Discover its applications, data formats, and how it works.

cynthiawtaylor
Download Presentation

Open source visualisatie met ADAGUC

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Open source visualisatie met ADAGUC Ernst de Vreede Maarten Plieger adaguc@knmi.nl http://adaguc.knmi.nl NMDC workshop “Visualisatie” 9 oktober 2014TNO, Utrecht

  2. Outline Atmospheric data ADAGUC software – Overview Application examples Application contexts Open Source Conclusions NMDC workshop “Visualisatie” 2014

  3. Atmospheric data – what’sso special? Observations in spaceand time • Point data forexampleobserving stations • Gridded data forexamplesatellite or precipitation radar Model data: forecasts in time andspace, usuallystartingfrom a certain “reference time” • Usuallygriddeddata (“fields”) Multidimensional data: • Atmosphere is a 3D structure • Time makes 4D • Reference time makes 5D • Ensembles make 6D NMDC workshop “Visualisatie” 2014

  4. Atmospheric data – data formats Standard meteorological data formats: GRIB/GRIB2: gridded, compressed data, WMO standard BUFR: binary format forobservations etc., WMO NetCDF: binary format, with metadata tobe “self-describing”, origin: Unidata (becoming OGC standard)NetCDF3: simplebinary formatNetCDF4: stores data in HDF5 format; more complex binarystructures/groups/hierarchical dataCF-conventions: set of conventionsfordescription of Climateand Forecast data (becoming OGC standard) Non-standard formats: A wholeuniverse of formats, binaryandtext-based, forsatellite data, radar data, observations etc. (XML, HDF4, HDF5,….) NMDC workshop “Visualisatie” 2014

  5. Atmospheric data – MetOcean DWG Coincidentally: ocean looks like upside-down atmosphere Meteorological and oceanographical communities started a MetOcean DWG in OGC (supported by WMO) First concrete result: Best Practices document for WMS, for handling time and vertical dimensions. Currently work is being done on developing MetOcean aspects of WCS 2.0 and on creating Best Practices for handling ensembles of forecast data in WMS NMDC workshop “Visualisatie” 2014

  6. ADAGUC software - Overview Open source software forvisualisation of atmospheric data Server: OGC WMS server (1.1.1 and 1.3.0) with WCS 1.0.0 server Server can access • CF-NetCDF data forgrids, point data, swath data fromsatellites • RGB images in NetCDF • HDF5 datasets (KNMI HDF5 forsat/radar) • Server canalso access remote OpenDAP datasets (e.g. climate datasets) Client: Generic web portal for (any) WMS services Embeddable viewer component for re-use in web applications NMDC workshop “Visualisatie” 2014

  7. Web Map Service - WMS Generates visualizations of geospatial data in the form of 2D images, suitable for transfer over the internet (JPG/PNG/GIF) MSG-CPP - Precipitation NMDC workshop “Visualisatie” 2014

  8. ADAGUC WMS: Detail NetCDF CF datafiles: grids/RGB images/point data Multidimensional (time, elevation, ensemble members, etc): 4D, 5D, 6D Implements MetOcean BP reference_time and elevation Preconfigurable styling (based on standard_name attribute) Autoconfigurable for example for visualisation of WPS output Extensions: GetReferenceTimes request GetFeatureInfo/GetPointValue Can also return data in JSON/JSONP Multiple dimension values (e.g. elevation=* returns data for all elevations) The GetMap extensions found in ncWMS (from UoR) NMDC workshop “Visualisatie” 2014

  9. How ADAGUC WMS works GRIB(2) HDF5 e.g. PyTroll e.g. Fimex ADAGUC service NetCDF WMS GetFeatureInfo ADAGUC ingest (meta)data WMS GetMap NMDC workshop “Visualisatie” 2014

  10. ADAGUC viewer: Detail Javascript browser application Uses ExtJS, Jquery for GUI elements Bespoke mapping subcomponents Viewer component is embeddable in other web pages NMDC workshop “Visualisatie” 2014

  11. Applications – GLAMEPS portal NMDC workshop “Visualisatie” 2014

  12. Applications – MSGCPP NMDC workshop “Visualisatie” 2014

  13. Applications – Polar satellite viewer (Suomi NPP) NMDC workshop “Visualisatie” 2014

  14. Applications: KNMI Data Centre • Portal for KNMI data: http://data.knmi.nl • Storage, catalogisation and publication of data and metadata • All sorts of data • Focus on metadata and searchability • NetCDF4 (and HDF5) data can be (pre)viewed with ADAGUC 16 NMDC workshop “Visualisatie” 2014

  15. Application contexts of visualisation at KNMI Operational (weather room) General research (models, satellites) Dedicated research (climate data) External parties (LVNL, VCNL) General public (www.knmi.nl) NMDC workshop “Visualisatie” 2014

  16. Application contexts: operational Operational (weather room) 4/5 positions, eachwith +/- 10 screens verymuch information Tasks: • Weather analysis & forecast • Security • Aviation services Fairlyhomogeneousaudience NMDC workshop “Visualisatie” 2014

  17. Application contexts: operational (2) Visualisation tools in operational context: dedicated: radar, satellite, observations “generic”: Meteorological Work Station for model data, observations, radar andsatellitecombinations (notall data!) intranet: veryinhomogeneouscollection of graphics Intranet: More and more “precookedproducts”: drivenby efficiency, workpressure, costs, slowness of change of dedicated systems. Very ad-hoc Web services canreally help heretocreateand combine all these products in a flexible way. NMDC workshop “Visualisatie” 2014

  18. Application contexts: operational (3) NMDC workshop “Visualisatie” 2014

  19. Application contexts: research General research: Manypositions Tasks: research Veryinhomogeneousaudience Visualisation tools in research context: Mostly more or lessgeneric tools: Fortran libraries (ECMWF) Metview (ECMWF) Python libraries, likematplotlib IDL Matlab Andmanyothers. Web services canalso help here: unification of access andstyle, flexibility NMDC workshop “Visualisatie” 2014

  20. Application contexts: dedicated research Research portals dedicatedtosome subject: Climate data: ecad.knmi.nl Climatemodels: climate4impact.eu NMDC workshop “Visualisatie” 2014

  21. Application contexts: Externalparties LVNL air traffic control: Data, visualisedproducts, embeddedforecaster VCNL road traffic control: Data, visualisedproducts, embeddedforecaster • Embedded forecaster : “light visualisations” , web-based • Web-services alsodirectlydeployable in external party’s systems NMDC workshop “Visualisatie” 2014

  22. Open Source In 2013: KNMI made ADAGUC open source License: MIT for server and Web Mapping component GPL V3 for ADAGUC Viewer http://dev.knmi.nl: Code repository Wiki ADAGUC workshop at KNMI in june 2013 NMDC workshop “Visualisatie” 2014

  23. Conclusions ADAGUC is a success for us: we’re using and re-using it. It could play a big role in operations, but resources needed for development. It can be used for batch production of maps etc. It can be used for building web applications for different purposes. By applying ADAGUC we hope to build it out further. NMDC workshop “Visualisatie” 2014

  24. Links ADAGUC information and demo site: http://adaguc.knmi.nl Redmine repository/wiki: http://dev.knmi.nl ADAGUC applications: http://msgcpp.knmi.nl http://climate4impact.eu NMDC workshop “Visualisatie” 2014

More Related