420 likes | 442 Views
Status of AMSR-E and AMSR-E Validation Data at NSIDC. Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Telluride, Colorado 14-16 July 2008. Outline. AMSR-E Archive and Distribution Status Data Support Distribution Statistics Activities at NSIDC AMSR-E Validation Status
E N D
Status of AMSR-E and AMSR-E Validation Data at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Telluride, Colorado 14-16 July 2008
Outline AMSR-E • Archive and Distribution Status • Data Support • Distribution Statistics • Activities at NSIDC AMSR-E Validation • Status • Distribution & Documentation Stats AMSR-E 12 km Sea Ice Concentration Sea Ice Record Year Minimum 16 September 2007 The magenta line indicates the long-term median from 1979 to 2000. September 2007 sea ice extent was 4.28 million square kilometers (1.65 million square miles), compared to 5.57 million square kilometers (2.14 million square miles) in September 2005. Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Archive and Distribution Status • Level-3 • V002 – 11 Jul 08 • V002 Reprocessing • Began 13 May 08 • Through Mar 04 • Sea Ice V002 Reprocessing • Began 9 July 08 • Level-1A & -2A • All Version 2 • Level-2B • V002 Reprocessing • Began 12 Dec 08 • Through Jul 06 • Rain V002 - 13 Nov 06 • Land V002 - 19 Apr 07 • Ocean V002 - 9 May 07 AMSR-E Data Versions: http://nsidc.org/data/amsre/versions.html Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Archive and Distribution Status ~17 TB Total Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Data Support: Documentation AMSR-E Documentation: http://nsidc.org/data/amsre/data_summaries.html • Performing documentation and metadata overhaul for Version 2 • Level-2B completed • Level-3 SWE, Land, and Ocean completed. Rain and Sea Ice in progress. • Using release notes and ATBD supplements AMSR-E Research: http://nsidc.org/data/amsre/research.html • Citations updated annually • Please email any additions or corrections to Amanda.Leon@nsidc.org or nsidc@nsidc.org Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Data Support: Ordering Data AMSR-E Order Data Page: http://nsidc.org/data/amsre/order.html Warehouse Inventory Search Tool (WIST)/ECHO • Migration from EDG to WIST as a part of ECS 7.21. • Automated user account migration tool. • Migration began 25 June 2008. Scheduled to end on 28 July 2008. • EDG -- http://nsidc.org/~imswww/pub/imswelcome/index.html • WIST -- https://wist.echo.nasa.gov/~wist/api/imswelcome/ Data Pool • On-line access via a user GUI or FTP site. • The entire archives of L1A, L2A, L2B Land, L2B Ocean, L2B Rain, L3 Land, and L3 12km Sea Ice are available for direct FTP. • Most recent 75 days available for all other products. • Will be moving towards all data on disk by ~2nd quarter 2009. • http://nsidc.org/data/data_pool/ Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Data Support: Ordering Data Search 'N Order Interface (SNOWI) • SNOWI developed in-house as an alternative to the EDG. • SNOWI-E (ECHO) replacing SNOWI by 28 July 2008. • http://nsidc.org/data/snowi/ Subscriptions • Data are automatically provided to the user at the time they are ingested at NSIDC. • http://nsidc.org/daac/subscriptions.html Preliminary (NRT) Data • Most recent eight days of L2 & L3 data provided on a non-ECS FTP server. • Registration is required. • http://nsidc.org/data/amsre/prelim.html Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Data Support: Tools & USO AMSR-E Tools Page: http://nsidc.org/data/amsre/tools.html • AMSR-E Swath-to-Grid Toolkit (AS2GT) • HDF-EOS Web-based (HEW) Subsetter • HDF-EOS to GeoTiff (HEG) • Hierarchical Data Format - Earth Observing System (HDF-EOS) • Interact with users to determine and understand their AMSR-E data needs. • Provide support of both in-house developed tools and proprietary software. • Coordinate product announcements, outreach materials, and NSIDC presence at meetings. User Services – nsidc@nsidc.org Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Total 18 June 2002 – 1 July 2008 Version 2 ~170 TBs Total Distribution Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Trends Granules from Tape Archive for 2004-2008 792,695 429,188 444,153 371,497 33,599 31,503 159,376 3,504 Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Trends Volumes from Tape Archive for 2004-2008 35,808.07 35,808 GB 25,150.40 21,645.00 19,475.72 19,476 GB 10,698.36 12,845 GB 10,698 GB Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Data Pool Granules from Data Pool for 2004-2008 416,166 282,102 157,292 69,789 74,582 74,582 Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Data Pool Volume from Data Pool for 2004-2008 31,478.17 14,508.00 8,964.00 2,433.10 2,554.34 2,433 GB Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Total • Combined tape archive and Data Pool distribution continues to increase 2003-2004 691% 2004-2005 68% 2005-2006 103% 2006-2007 26% Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Users 18 June 2002 – 1 July 2008 43 % - U.S. Users 57% - Foreign Users Stats from USO TRAK Database Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics: Users Users of all NSIDC Data 58% Stats from EDGRS (until 30 June 2007) & EMS Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Distribution Statistics Preliminary (NRT) AMSR-E Data 78 distinct users have registered for the NRT data this year. AMSR-E Swath-to-Grid Toolkit Statistics from our University FTP site & TRAK through 1 July 2008 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Activities at NSIDC • ADEOS-II AMSR L1A data • Web site, documentation, & data have been available for a year. • No users have become approved users. • http://nsidc.org/data/amsr/index.html • JAXA GCOM-W Science Team Proposal • AMSR-E 12 km Sea Ice Visualization • Automating a process to provide daily images for NASA’s Science on a Sphere and Magic Globe, Google Earth, and hopefully others. • AMSR-E Daily Global EASE-Grid & 1/4 Degree Gridded Tbs • Data available from March 2007 – May 2008. • Beginning to reprocess back to start of AMSR-E mission. • http://nsidc.org/data/nsidc-0301.html • http://nsidc.org/data/nsidc-0302.html Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Activities at NSIDC • AMSR-E and AVDM web site redesigns. • PMSDT (AS2GT) • PMSDT-0.5 released in June 2008. • New AMSR_E_L2A_togs with more flexible for dropping samples asymmetrically from the ends of the scans and some range-of-value checking. • NSIDC’s Search-Light Development • Quick search, retrieval, display, and delivery. • Simple to use interface for cryospheric data. • Access to all NSIDC data. • Provide data in user specified format. • Allow users to display and interact with data. • Create a a standard & flexible framework for new applications. Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Validation Status & Stats Distinct Users Cryosphere: 89 (16% ) Rainfall: 256 (11% ) Soil Moisture: 1173(24% ) Total: 1470(8% ) • Cryosphere • Meltpond 2000 • AMSRIce03 • AMSRIce06 • Alaska Sea Ice • West Antarctic Sea Ice • East Antarctic Sea Ice • Sea of Okhostk • Puenta Arenas • Rainfall • Iowa City, IA • Eureka, CA • Wakasa Bay • BALTEX • Soil Moisture • SMEX02 • SMEX03 • SMEX04-NAME • SMEX05 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Validation Distribution Stats Files download from FTP site through 1 July 2008 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Validation Distribution Stats Volume downloaded from FTP site through 1 July 2008 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Validation Data & Documentation 68% 66% Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Validation Documentation Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Summary AMSR-E • Version 2 is here and all reprocessing is underway. • Distribution & users continue to increase. • Moving towards all data on-line. AMSR-E Validation • Distribution & users are increasing. • Working on documentation/metadata process efficiencies. • Will be following up with PIs to obtain data. Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Team at NSIDC Thanks to the AMSR-E Teams at NSIDC! AMSR-E Validation Chris Bond – Operations Karla LaFevre – Technical Writer Lori Olcott – Technical Writer Brad Hammerschmidt – User Services Jeff Smith – Programmer AMSR-E Chris Bond – Operations Deann Miller – Technical Writer Brad Hammerschmidt – User Services Jeff Smith – Programmer Siri Jodha Khalsa – ECS Science Coordinator Walt Meier – Scientist Doug Fowler – Test Engineer Cathy Fowler – Database Administrator Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Backup Slides Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
ADEOS-II/AMSR Data Status • Started ingesting Version 2 AMSR L1A data from JPL • After ingest has completed, the on-line metadata tables will be populated • Considering using ECHO and WIST to facilitate search and order for NASA approved users • ECHO provides Access Control Lists that permit only approved users to search and/or order restricted data sets Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
ADEOS-II/AMSR Data Status Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
ADEOS-II/AMSR Data Status Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Archive and Distribution Status: Data Versions Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Tools for AMSR-E Data: NSIDC-developed Toolset • The AMSR-E toolset presented at the JSTM in September 2005 will now be incorporated into a center-wide tools package to be developed for all ECS data sets • AMSR-E Toolset functionality • GUI-driven tool set to display and manipulate AMSR-E Level 2 swath and Level 3 gridded data • Re-grid Level 3 data to alternative projections • Custom gridding of Level 2 swath data • Subsetting: row-column and lat-lon • Create composite images Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AS2GT: AMSR-E Swath-to-Grid Toolkit • NSIDC’s Ken Knowles developed AS2GT. • The AMSR-E Swath-to-Grid Toolkit (AS2GT) is a suite of software tools to subset and grid Levels 1B and 2A AMSR-E swath data. • AS2GT makes it possible to quickly and easily work with the AMSR-E data in ways that may not be available in the Level 3 gridded data sets. • This toolkit allows you to process data into custom grids with whatever temporal or spatial resolution you require. • AS2GT maintains the highest data quality for your application by giving you control over map projection, number of samples per day, input resolution and interpolation method. • Gridding options in AS2GT include: • Map projection • Resolution and grid dimensions • Resampling method • How to handle overlapping swaths • Subsetting by time or region Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AS2GT: AMSR-E Swath-to-Grid Toolkit Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Data Flow Interfaces EDOS L0 AMSR-E Data Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Data Products Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Data Products (cont.) Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Data Products (cont.) Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
AMSR-E Data Products (cont.) Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008
Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 14-16 July 2008