320 likes | 496 Views
AMSR-E and AMSR-E Validation Status at NSIDC. Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Oxnard, CA 4-5 September 2013. Outline. Standard Products Status Metrics AMSR-E Related Products Status Metrics Data Access & Discovery User Support
E N D
AMSR-E and AMSR-E ValidationStatus at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Oxnard, CA 4-5 September 2013
Outline • Standard Products • Status • Metrics • AMSR-E Related Products • Status • Metrics • Data Access & Discovery • User Support • Data Quality Information • Long Term Archival Sea ice derived from the AMSR-E 89 GHz Tbs. Image courtesy of NASA/GSFC Visualization Studio
Standard Products: Status • Level-2A Version 3 announced to public on 14 June 2013 • Reprocessing completion announced 26 July 2013 • Version 2 will be publicly available for 6 months post reprocessing (27 Jan) • Level-3 Sea Ice Products • Reprocessing initiated in September 2012 to integrate a new Antarctic land mask. • Integration of mask caused valid data in SH to be masked in 12.5 & 25 km Sea Ice Concentration and 6.25 Sea Ice Drift • Removed affected data and republished previous version • Awaiting another reprocessing effort nsidc.org/data/amsre
Archive Metrics: Volume • 1 June 2002 – 31 July 2013 Current Version Archive Volume Total Current Version Archive: 16.4 TB Total Archive (V001, V002, V003): 28 TB • Archive retention plan: • Keep the Current Version and the Previous Versionof all products. • Keep All Versions of L2A Stats from EMS
Distribution Metrics: Total Sorted on Volume 1 June 2002 – 31 July 2013 Total Distribution: 589 TBs 24.3 million files Stats from EMS
Distribution Metrics: Files Jan 2004 – July 2013File Distribution Stats from EMS
Distribution Metrics: Files Jan 2011 – Jul 2013 Files/Month Antenna Spin Down 10/4/2011 Jan 2013: L2A Dec 2012: L2A & L2B Land, Ocean, Rain Mar 2013: L2A & L2B Rain
Distribution Metrics: Volume Jan 2004 – July 2013Volume (GB) Distribution
Distribution Metrics: Volume Jan 2011 – Jul 2013 GB/Month Antenna Spin Down 10/4/2011 Jan 2013: L2A & L3 Land Mar 2013: L2A & L3 Land Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 4-5 September 2013
Distribution Metrics: Users 1 June 2002 – 31 July 2013 2,519 Total Distinct Users U.S. Users – 46% Foreign Uses - 54% Stats from EMS & USO TRAK Database
Distribution Metrics: Users Jan 2003 – Jul 2013 Total Distinct Users per Year Stats from USO TRAK Database
Distribution Metrics Top 10 Countries by Fiscal Year (by Volume, Files, and Users) FY 2012 FY 2013
AMSR-E Related Products AMSR-E Validation Data nsidc.org/data/amsr_validation/ • No changes Other AMSR-E Related Products • John Kimball’s MEaSUREs Global Record of Freeze/Thaw nsidc.org/data/nsidc-0477.html • Version 2 Release • AMSR-E Global Land Surface Emissivity nsidc.org/data/nsidc-0543.html • HamidrezaNorouzi; New York City College of Technology, The City University of New York (CUNY) • On the horizon: Aquarius Soil Moisture; AMSR2; SMAP
AMSR-E Validation: Distribution Metrics Total Distinct Users Per YearJan 2011 – July 2013 Statistics from our University FTP logs
AMSR-E Validation: Distribution Metrics Total Files Distributed Per YearJanuary 2011 - July 2013 Statistics from our University FTP logs
AMSR-E Validation: Distribution Metrics Total Volume (MB) Distributed Per YearJanuary 2011 – July 2013 Statistics from FTP logs
Other AMSR-E : Distribution Metrics Jan 2007 – Jul 2013 Files per Year
Other AMSR-E: Distribution Metrics Jan 2007 – Jul 2013 MBs per Year Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC 3-4 September 2013
Other AMSR-E: Distribution Metrics Jan 2007 – Jul 2013 Distinct Users per Year
Discovery & Access Data Pool GUI Retired • HDF-EOS to GeoTIFF (HEG) data services now accessible in Reverb • Data Pool FTP site remains for direct data access REVERBreverb.echo.nasa.gov • FTP download All Products • Data services Most Standard Products • Spatial & Parameter Subsetting, Reformatting to GeoTIFF, Projection Conversion OpenDAPnsidc.org/opendap/Standard Products • Provides data variable display and output to ASCII and binary Polarishttp://nsidc.org/data/polaris/EASE-Grid & .25 deg TBs • Data services: Spatial & Parameter Subsetting, Reformatting, Projection Conversion nsidc.org/data/methods.html
Discovery & Access: NSIDC Data Search • Metadata Project – Completed • Improved metadata efficiency and accuracy • Betterdata search results • More complete data documentation • NSIDC Search – In Work • User feedback: Challenging to find and select data which best meets needs • Plans: • Improved search algorithms • Faceted browse • Data comparison • Timeframe: Initial release before end of 2013
User Support • User Services Knowledge Base support.nsidc.org/forums • Dynamic FAQs and other data support • The Driftnsidc.org/the-drift/ • Consolidated online data announcements, data highlights, tools, and tips into a blog-style Web site • Replaces NSIDC Notes Most Common User Questions • Provide guidance on which data set to use or which data within a data set • Provide guidance on information in the documentation • How do I open/read [data set] in [format] with [tool]? • How do I convert from [x data format or x projection] to [y data format or y projection]? • Is there a way to extract data for only the region I need in [data set]? nsidc.org/data/amsre
Data Quality Information • Aqua Senior Review Committee requested a centralized source of AMSR-E uncertainly information. • NSIDC agreed to host an "AMSR-E Data Product Confidence" Web page • Synopsis on sources of uncertainty. • The best estimates of data uncertainty under optimal conditions, expressed in terms appropriate to each measurement. Where possible, express this as "95% confidence interval". • A description of how to interpret quality flags to understand the conditions under which uncertainty may be greater. • Completed: Sea Ice, SWE, Soil Moisture • Suggestion by Marco: develop a 'standardized' measure so that it would be easier to look at the results of the survey.
Long Term Archival • ESDIS developed the NASA Earth Science Data Preservation Content Specification (423-SPEC-001, Nov 2011) • “This document defines the contents of data, metadata and associated documentation to be preserved beyond the life of missions funded by NASA’s Earth Science Division (ESD).” • NSIDC will coordinate the collection and archival of material • Doug Fowler (ICESat Data Management Lead) • Science Team, TLSCF, SIPS, and JAXA will beessential to the LTA collection process • Need to capture knowledge before people move on • Documents • should be archived in a persistent format, like PDF • are either submitted to the NASA Technical Reports Server (NTRS) or become an unofficial part of the LTA
Long Term Archival * Proved difficult to collect with ICESat
AMSR-E Team at NSIDC Thanks to the AMSR-E Team at NSIDC! AMSR-E Chris Bond – Operations Karla LeFevre – Technical Writer Shannon Leslie– User Services Siri Jodha Khalsa – ECS Science Liason ? Walt Meier @ GSFC now – Scientist Cathy Fowler – Database Administrator