100 likes | 282 Views
EOSDIS Status. 10/16/2008 Dan Marinelli, Science Systems Development Office. Distributed Active Archive Centers (DAACs). REASoN. ACCESS. Adapted from. Instrument Science Team Facilities (SCFs and SIPSs). Data Assimilation Model. EOSDIS Context. EOSDIS Mission Profile.
E N D
EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office
Distributed Active Archive Centers (DAACs) REASoN ACCESS Adapted from Instrument Science Team Facilities (SCFs and SIPSs) Data Assimilation Model EOSDIS Context
Earth Science Data and Information System (ESDIS) Project - GSFC Code 423 • Objective - Develop and Operate Earth Observing System Data and Information System (EOSDIS) • A production capability for standard science data products from EOS instruments • An “active archive” of Earth science data from EOS and other past and present Earth science missions • A distributed information framework (data centers, system elements, interfaces and data model) supporting EOS investigators and other users in science, government, industry, education, and policy • Organizations: ESDIS Project meets its requirements by funding and managing several organizations including • “Large” industrial: Raytheon (EMD) • Distributed Data Centers - NASA Centers (GSFC, JPL, LaRC), other government agencies (EDC, ORNL), Universities (ASF, NSIDC, SEDAC) • Science Investigator-led Processing Systems (SIPSs) - NASA Centers (GSFC, JPL, LaRC, MSFC), NCAR • Project Components: • SDPS - System for ingesting, processing, archiving and distributing data • Data Centers - Science System Operations • EOSDIS Networks - Transportation of mission & science data • SIPS - Systems developed and operated by PIs or Team Leaders for generation of standard data products for delivery to Data Centers • Status • EOSDIS has been successfully supporting EOS missions since 1999 • Volume of data available from EOS missions continues to grow. Current volume at 4.9 petabytes. • EOSDIS archive contains current as well as legacy Earth science data - more than 2700 datasets • In FY 2007, over 100 million products were distributed to just over 165,000 unique users; approximately 3.0 million distinct users accessed the EOSDIS data centers. • ESDIS Project is working closely with the user community to enhance systems that support and provide access to data • Web Site: http://eos.nasa.gov/eosdis
Monthly Distribution by Products (Sep 2007 - Aug 2008) ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC 20,000 18,000 16,000 14,000 12,000 10,000 Product Counts (in 1000's) 8,000 6,000 4,000 2,000 0 Sep-07 Oct-07 Nov-07 Dec-07 Jan-08 Feb-08 Mar-08 Apr-08 May-08 Jun-08 Jul-08 Aug-08 Month
Monthly Distribution by Products (Sep 2006 - Aug 2008) ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC 20,000 18,000 16,000 14,000 12,000 10,000 Product Counts (in 1000's) 8,000 6,000 4,000 2,000 0 Jul-08 Jul-07 Jan-08 Jun-08 Jan-07 Jun-07 Mar-07 Mar-08 Feb-08 Feb-07 Sep-07 Oct-07 Apr-08 Sep-06 Oct-06 Apr-07 Dec-07 Dec-06 May-08 May-07 Nov-07 Nov-06 Aug-08 Aug-07 Month
Monthly Distribution Volume (Sep 2006 - Aug 2008) ASF EDC GSFC JPL LaRC Latis NSIDC ORNL MODAPS GHRC SEDAC 250 200 150 Volume (TB) 100 50 0 Jul-08 Jul-07 Jan-08 Jan-07 Jun-07 Jun-08 Mar-07 Mar-08 Apr-07 Feb-08 Apr-08 Feb-07 Oct-07 Oct-06 Sep-07 Sep-06 Dec-07 Dec-06 Nov-07 Nov-06 May-07 May-08 Aug-08 Aug-07 Month
Recent Progress • Transition from EOS Data Gateway (EDG) to ECHO/WIST Underway. NSIDC, Oak Ridge, and Alaska DAACs have completed transition. Over 1600 new users currently accessing EOS data via ECHO/WIST. • Will complete once ECS 7.21 is operational at all sites • 7.21 was deployed and includes ingest of all data via Data Pool, conversion to an XML archive for metadata, distribution enhancements
Plans for the next year • ECS Release 7.22: work underway for final delivery planned under EMD Contract - will include: • Custom code changes to support transition to disk-based archive • Improvements to Bulk Metadata Generation Tool to automate response to error conditions in interface to ECHO • Enhanced Checksumming, including validation of integrity of files in the datapool and archive • Operating System and Compiler Upgrades (including custom code changes) • Code simplification - complete removal of all remnants of Science Data Server and heritage Storage Management components (replaced in Release 7.21)
EOSDIS Futures • Future spending profile reflects reductions being achieved with evolution • GES DISC off of ECS; MODAPS performs MODIS processing and L1/atmospheres archive and distribution • ASDC DAAC now supports CERES with their ANGe system; ECS to remain in place through at least 7.22 for other EOS instruments • ECS evolution development to be complete by March 2009 – has resulted in greatly reduced physical, SLOC footprint, and thus cost to maintain • ECS contract expires May 2009; ESDIS is putting together RFP for the follow-on ECS Evolution and Development Contract • THG grant renewed 7/2008 for 3 years • New NASA guideline implies we may not be able to host this workshop in the future – we’ll keep you posted