The GFDL Data Portal A NOAA partnership

1. The GFDL Data PortalA NOAA partnership Kevin O’Brien Steve Hankin Serguei Nikonov V. Balaji

2. Background • GFDL

3. Background • TMAP • PMEL

4. Introduction to LAS The Live Access Server (LAS) A highly configurable Web server designed to provide flexible access to geo-referenced scientific data

5. Introduction to LAS LASTwo types of configurability • Configurable hierarchical presentation • to address different “information architectures” • Configurable data browse/access • to address grids, variables, constraints, …

6. Introduction to LAS Configurable hierarchy of information Example – GODEA Intercomparison

7. Introduction to LAS Configurable hierarchy of information Example – NDBC Buoy Prototype

8. Introduction to LAS Once the dataset or variable of interest has been identified …

9. Introduction to LAS

10. Matlab, IDL, IDV, Ferret, GrADS, … Information Products netCDF, HYCOM binary, ASCII, GIS layers

11. Introduction to LAS

12. FDS (Ferret Data Server) • FDS is an OPeNDAP server • Automatically installed with LAS • Therefore every gridded LAS dataset is served via OPeNDAP • Has extended analysis capabilities beyond basic OPeNDAP servers

13. Introduction to LAS Compare Fields

14. Introduction to LAS Compute simple analyses

15. Introduction to LAS LAS UI LAS core Meta- Internet (perl) data Standard legacy Local application Data Batch ( Ferret ) K-12 Multiple User Interfaces The UI talks to LAS through an XML “web service”

16. Introduction to LAS

17. Introduction to LAS

18. Technical challenges include: • Managing large collection of model files • Directing “customers” to desired data • Controlling resource-intensive data requests • Dealing with curvilinear coordinate systems

19. Technical challenges include: • Managing large collection of model files • Annual, monthly, daily, 3-hourly, etc • Directing “customers” to desired data Solution: Unidata Aggregation server and OPeNDAP • Handling resource-intensive data requests • Dealing with curvilinear coordinate systems

20. Technical Challenges Solution: Unidata Aggregation server and OPeNDAP • Unidata Aggregation server • Combines a group of files/datasets into one logical dataset • Uses THREDDS catalogs to specify the datasets it serves • OPeNDAP • Allows access to remote data via the internet, using http • format of the native data not a worry • only need to transfer the subset of interest

21. Technical challenges include: • Managing large collection of model files • Directing “customers” to desired data • Handling resource-intensive data requests Solution: Use LAS “categories” • Dealing with curvilinear coordinate systems

22. LAS categories: GFDL Data Portal

23. LAS categories: GFDL Data Portal

24. Search coupled coupled

25. Index

26. Technical challenges include: • Managing large collection of model files • Handling resource-intense data requests • Directing “customers” to desired data Solution: LAS defaults to a “batch” mode for large requests • Handling resource-intensive data requests • Dealing with curvilinear coordinate systems

27. LAS “Batch” mode

28. Technical challenges include: • Managing large collection of model files • Dealing with curvilinear coordinate systems • Directing “customers” to desired data Solution: Ferret, FDS, regridding…… • Handling resource-intensive data requests • Dealing with curvilinear coordinate systems

29. XY plot of curvilinear data

30. netCDF subset of curvilinear data • Using nc operators

31. Future directions: • Automation • Implement standards for regridding • Expand Modeler community • Increase “fusion” of GFDL models with others • OPeNDAP • LAS Sister Servers • Several different LAS servers which share XML

32. For more information: • Ferret: http://www.ferret.noaa.gov • LAS: http://www.ferret.noaa.gov/Ferret/LAS • GFDL data portal: http://nomads.gfdl.noaa.gov • OPeNDAP: http://www.opendap.org Thank you!