90 likes | 212 Views
SPG Report Back. Richard Ullman Glenn Cunningham Oct 22, 2010. Wed Joint WG Meeting Contributions. Focus of the joint WG sessions on Wednesday was “Data Interoperability”
E N D
SPG Report Back Richard Ullman Glenn Cunningham Oct 22, 2010
Wed Joint WG Meeting Contributions SPG Breakout Report ES-SDWG 22 Oct. 2010 Focus of the joint WG sessions on Wednesday was “Data Interoperability” Plenary talk by Rich Ullman – Talk describing the file formats and metadata RFCs (standards and tech notes) recommended by the SPG (HDF5, HDF-EOS5, NetCDF Classic, ICARTT, Aura Guidelines, GCMD DIF, CF Conventions, ECHO Metadata Model) Barry Weiss – talk about the SMAP decision making process in selecting file format and metadata standards – generated lots of discussion; Other DS mission teams can revisit his decision making trades when faced with their standards decisions Siri Jodha Khalsa – talk about the Metadata Evolution for NASA Data Systems (MENDS) status; Big team from disparate backgrounds. Consensus building for NASA profile of ISO.
SPG Breakout 1: Reference Architecture Status SPG Breakout Report ES-SDWG 22 Oct. 2010 Michael Burnett gave a presentation giving an overview of the SPG’s Reference Architecture Technical Working Group. Writing team is composed of Michael Burnett, Rich Ullman, Emily Law, Nettie Labelle-Hamer, Barry Weiss Team came to agreement on high level use cases to define a mission data system, the survey of stakeholders, the different views that will define the reference architecture (system architectural view, technology view, information architecture view, product value view, function view, user view), glossary, and annotated outline Schedule of milestones & deliverables; Anticipated completion June 2011 Additional working meeting w/members of writing team Result of SPG discussion: limit the scope of the reference architecture to what will help future DS mission team identify scope of work for defining a mission data system and identify interfaces where they need to define standards.
SPG Breakout 2: ISO Metadata SPG Breakout Report ES-SDWG 22 Oct. 2010 Ed Armstrong gave a talk on the Group on High Resolution Sea Surface Temperature (GHRSST) project’s ISO metadata profile. GHRSST is an international consortium founded in 2001 to coordinate the production of improved and consistent SST records across four continents in common data and metadata format. Over 50 unique SST products to date for 15 unique SST sensors. Previously used NetCDF3 and DIF. From 2012, will use NetCDF4 and ISO metadata. Implemented Collection and granule metadata in ISO 19115-2. Lineage and data quality metadata not tackled yet Barry Weiss gave a talk on the SMAP ISO experiences SMAP designed nominal ISO schema for collection and granule metadata
ISO Metadata (cont) SPG Breakout Report ES-SDWG 22 Oct. 2010 ISO adoption by other DS teams and by NASA data centers should use ISO metadata standards the same way. Strongly recommend a NASA profile of core ISO elements (19115, 19115-2, 19130). Which of the optional elements (e.g. platform) should be declared mandatory for NASA Earth science data? Siri Jodha continued his discussion of the MENDS ISO metadata activities. Should MENDS produce a profile of ISO metadata for use for NASA data? What should be included in this profile? Note: 19115 is currently undergoing revision for the next 2 years. Any extensions or revisions to the 19115 standard needed for NASA data can be provided as input to the revision committee.
SPG Breakout 4: File Formats SPG Breakout Report ES-SDWG 22 Oct. 2010 • Kent Yang gave 2 talks: • Tools and Applications for HDF5 • HDF5 and NetCDF4 Compatibility • A lot of technical information for mission teams and data center reps points to need to address the details of HDF5 implementation. • Ed Hartnett gave a talk on NetCDF4.
SPG Breakout 5: Technology tracking and Future Work • ISO 19115 Profile(s) • NASA profile, ECHO, GHRSST... • GeoTIFF • OODT (more than a data access tool!) • How to deliver data to a data center • CDX • Data quality/integrity - practices for checking/verifying files • MPARWG did spend time on data quality metric • QA4EO (qa4eo.org?) CEOS... • Data access services (beyond WCS...) • THREDDS catalogs • PODAAC implementing THREDDS servers... • WCS RFC (from GMU team) • Revisit WMS 1.1.3? Is it in more operational use now? • Should SPG revisit all RFCs periodically? • CS/W? Is it in operational use now? • What’s being used enthusiastically? • NASA profile for HDF5, NetCDF (decadal survey) (alternative to HDF-EOS5) • Coordinate naming, common epoch, timestamps, leap seconds,... • Time Tech Note • Decadal missions to look at this from their point of view • FGDC newly endorsed set of 64 standards • look into what the impact is, which are applicable, etc. - formulate guidelines • recommendation to HQ • what’s the process to do this? SPG Breakout Report ES-SDWG 22 Oct. 2010
Group Picture SPG Breakout Report ES-SDWG 22 Oct. 2010
SPG “tech-note”– Café Negril SPG Breakout Report ES-SDWG 22 Oct. 2010