CLPx Data Management

1. CLPx Data Management Mark Parsons 9th Cold Land Processes Workshop 28 May 2003

2. Field data collection process • Interview surveyor and note any idiosyncrasies • Photocopy field notebook • Enter data into spreadsheets according to detailed style sheet • Download photos and save according to surveyor • Note questions for surveyor and follow up at briefing • Print and review data entry accuracy • Check counts, means, and standard deviations (depths) • Convert to ASCII and run auto QC and formatting (pits) • Make backups and deliver beta version of data • Produce GIS images and review Cold Land Processes Workshop 28 May 2003

3. Unique aspects of field data collection • Data entry techs (data monkeys) learned data protocol first hand; • Aware of changes in protocol (briefings); some say in protocol changes • Collected data as well as entered • Data entry while collection fresh in surveyor's mind catches errors and clearly identifies idiosyncrasies (Saved as much as 10-20% of data collection that would otherwise have to have been thrown out due to unanswerable questions.) • “Touching the data”—Data monkeys had some understanding of data applications, processing, and science and caught things a computer wouldn’t • “Belt and suspenders” back ups Cold Land Processes Workshop 28 May 2003

4. Additional QC and formatting • Rename photos and edit according to surveyor comments (Four photo types: roughness, general terrain, pit wall detail, other) • Create/Revise automated QC and formatting scripts • Produce final QCed ASCII tables of the data (over 30 warnings, and QC flags) • Derived values include snow water equivalent and various means, maximums, and minimums. • Thorough documentation and references Cold Land Processes Workshop 28 May 2003

5. Satellite data from NSIDC • MODIS, SSM/I, AMSR • Common grids and formats: • UTM and Geographic grids of the LRSA • GeoTIFF and flat binary files with ASCII headers • Individual files per channel Cold Land Processes Workshop 28 May 2003

6. We’ve collected basic metadata for all data sets. Thanks to our data wrangler, Nick. Please contact me or Nick Rutter to make data delivery arrangements:parsonsm@nsidc.orgnrutter@nohrsc.nws.gov 303-492-2359 952-361-6610 ext. 230 Please deliver final data Data will be embargoed to CLP investigators for one year from receipt All data will be open to the public 1 October 2004 Other data Cold Land Processes Workshop 28 May 2003

7. Current Data Access • Data currently embargoed to CLP investigators. 1st public data release 1 Oct. 03 • You must register with NSIDC and be approved by the Chair of the CLP working group • Register at http://nsidc.org/data/clpx/ • Access data at ftp://sidads.colorado.edu/clpfive subdirectories • aircraft • ground_data • ground_remote_sensing • incoming • satellite • Summary table of data available at http://nsidc.org/data/clpx/data.html Cold Land Processes Workshop 28 May 2003

8. Cold Land Processes Workshop 28 May 2003

9. Data sets currently available Cold Land Processes Workshop 28 May 2003

10. Future data access • All products listed in NSIDC data catalog with simple search and subject and title indexes • Summary table of all CLP products, temporal and spatial coverage, and parameters • Sophisticated search by space, time, parameter, and source? • Integrated (e.g., GIS) data set of key parameters Cold Land Processes Workshop 28 May 2003

11. Key gridded remote sensing radiances and reflectances (Pathfinder channels?) Remote sensing derived products: Snow water equivalent Snow-covered area Snow depth Grain size Soil moisture Freeze/thaw Key in-situ measurements SWE Snow depth Snow wetness Grain size Surface roughness Soil, snow, air temperature Soil moisture Other Met data? Separate consideration of LSOS? Integrated data set parameters Cold Land Processes Workshop 28 May 2003