200 likes | 344 Views
AmeriFlux Data Management. Tom Boden Carbon Dioxide Information Analysis Center Oak Ridge National Laboratory Presented January 31, 2011 at the 2011 AmeriFlux Science Meeting/3 rd NACP All-Investigators Meeting New Orleans, Louisiana. AmeriFlux Network. Participation Requirements
E N D
AmeriFlux Data Management Tom Boden Carbon Dioxide Information Analysis Center Oak Ridge National Laboratory Presented January 31, 2011 at the 2011 AmeriFlux Science Meeting/3rd NACP All-Investigators Meeting New Orleans, Louisiana
AmeriFlux Network Participation Requirements > Make year-round core measurements using the eddy-covariance technique > Submit data to the Carbon Dioxide Information Analysis Center (CDIAC) within 1 year of collection > Participate in AmeriFlux Science Meetings and synthesis & modeling activities 142 sites in 5 countries; 94 active sites, 48 inactive sites
AmeriFlux Data Summaryhttp://public.ornl.gov/ameriflux/viewstatus_ameriflux.cfm 142 AmeriFlux sites 134 sites have submitted data to CDIAC totaling 745 site-years 20 sites have submitted data for 2010 81 sites with Level 4 data available 71 sites have submitted biological data including 48 site BADMs
Level 1 to Level 2 Data Processing Scheme Level 1 data received from AmeriFlux site PIs • Flux, Meteorological, and Ecological Data Files • Stored “as received” from investigator • File format, parameter names, and units unchanged L1 files available from FTP area • Add value through automated QA/QC • Range checks, missing values, check solar elevation and time stamp • Basic Statistics (mean, variance, range) • Gap Analysis: determine frequency and duration of gaps in record • Spike detection, stationarity, diurnal and seasonal pattern • Cross checks/correlations (Rg vs. PAR) • Graphical Analysis: time series, property vs property, frequency | | 5 days | | Perform QA/QC • Incorporate into network-wide database • Convert into standard AmeriFlux units, reporting intervals, and naming conventions • Generate core parameters (e.g., VPD) where needed Calculate additional parameters, add to network database L2 data products available via Web interface and from FTP area • Web access to network-wide database • Querying capabilities – time, measurement parameter, and site • Graphics generation and data retrieval capabilities • FTP access to standard files • Standard files with 40 core variables (csv, NetCDF, tar) • Metadata files (html & txt formats) Incorporate into Web data interface & produce standardized data files & metadata reports
La Thuile, Italy FLUXNET WorkshopFebruary 18-22, 2007 Mandatory data: NEE/FC CO2/SFC U*/TAU Rg/PAR Ta H2O/RH/VPD • Participation and data response • ~60 participants, good representation from regional networks and major programs (LBA, TCOS) • 921 site yrs of data from 240 sites worldwide (33 countries) • 318 site yrs of data from 77 AmeriFlux sites • Resulted in ~60 proposed papers • http://www.fluxdata.org • Another iteration of the La Thuile database is underway with release in 2011 • provided 83 AmeriFlux site records (440 site yrs of data) • 23 sites without L4 products available
Update on gap-filling meteorological data • We have completed developing, implementing and evaluating algorithms to gap-fill meteorological data for AmeriFlux sites. • A major improvement since the last AmeriFlux annual meeting was the inclusion of reanalysis data (i.e., NARR) as an additional gap-filling tool. Now we are better able to fill long gaps (from weeks to months) for some terms, such as incoming solar radiation, soil moisture, and soil temperature. Gap-filling of precipitation records was also improved. • Gap-filled meteorological data sets for AmeriFlux sites will be officially posted in the coming months. • Please see Bai Yang’s poster for details!!
AmeriFlux Data System Site & PI Information, Pubs, & Instruments 12/2008 http://ameriflux.ornl.gov/edit http://ameriflux.ornl.gov Metadata (e.g., Fc corrections, instrument calibrations FY 2011 Reported Variables Flux & Met/Bio 1/2009 3/2009 CDIAC MS SQL 2005 RDBMS Flux & Meteorological Data Commenced 8/2009 Users Worldwide PHP Interface ORNL AmeriFlux & FLUXNET Data Team PHP Interface Leaf Aci 3/2010 Biological Data BADM 11/2009 http://leafweb.ornl.gov Gu EDO methodology & code Web interface/Sharepoint for data submission and dissemination of results
LeafWebhttp://leafweb.ornl.gov Please see Lianhong Gu’s poster for details!
AmeriFlux Data System Site & PI Information, Pubs, & Instruments 12/2008 http://ameriflux.ornl.gov/edit http://ameriflux.ornl.gov Metadata (e.g., Fc corrections, instrument calibrations FY 2011 Reported Variables Flux & Met/Bio 1/2009 3/2009 CDIAC MS SQL 2005 RDBMS Flux & Meteorological Data Commenced 8/2009 Users Worldwide PHP Interface ORNL AmeriFlux & FLUXNET Data Team PHP Interface Leaf Aci 3/2010 Biological Data BADM 11/2009 FY2010 Priorities Data extraction/e-mail notification Load remaining L2 data, begin loading L4 data Web migration Inclusion of L2 & L4 data in the Earth System Grid Biological data editing functionality http://leafweb.ornl.gov Gu EDO methodology & code Web interface/Sharepoint for data submission and dissemination of results 9
http://ameriflux.ornl.gov • Tool was launched in March 2008 • 2010 Additions – loaded L2 data, search capabilities for biological data, downloading & subsetting functionality, notification features, and links to detailed site descriptions • Since March 2009, >5600 searches and downloads • Please see Misha Krassovski poster/Wed. side meeting for details
Priorities for 2011 • Continue to process data and contribute towards synthesis and modeling activities • Expand data interface • Add gap-filled L2, L3 & L4 data • Include visualization capabilities • Add additional query capabilities (e.g., day vs. night) • Release Version 1 of the gap-filled met product • Review and embellish submitted biological data • Quantify uncertainty for flux terms in the L2 and L4 data products
Questions http://public.ornl.gov/ameriflux http://ameriflux.ornl.gov
Primary FY2011 CDIAC AmeriFlux Team Misha Krassovski – data system - (0.9 FTE) Bai Yang – micrometeorologist [QA/QC] - (0.8 FTE) Barbara Jackson – SAS programming - (0.7 FTE) Tom Boden – coordination - (0.3 FTE) Lianhong Gu – A/Ci analysis – (0.04 FTE)
F L U X N E T - a network of networks Global Network Non-network sites Regional Networks CARBOEURO- FLUX AmeriFlux Canadian CP AsiaFlux OzNet Oceania Americas Europe Asia - Japan Tower Sites Architecture of Global / Regional Flux Networks
AmeriFlux Data Processing & Products Site Investigator & Team CDIAC FLUXNET Site Proc. Flux/Met Data 30 min Averages Quality Flags Gap-filled NEP/Re QA/QC Network-wide Database Standard Files Site Proc. Biological Data BADM CADM Level 0 Level 1 Level 2 Level 3 & 4
Aci/Leaf Photosynthetic Capacity/WUE Web Interface • Approach described in Gu et al. (submitted to Journal of Experimental Biology) • System under development/testing • Previous data submissions used to test system as analysis & paper preparation proceed • Prescribed data format with headers and data blocks (e.g., leaf temp, internal CO2 conc.) that follow standard output from the LI-COR 6400 • Interface Features • On-line data submission & format verification • Results (e.g.,Vcmax, Jmax, Rd) posted to CDIAC FTP area as images & data files • Long-Term Goal : Develop Network-wide AmeriFlux Leaf-level Database
Forcing SFA Modeling / data assimilation Theoretical analysis Numerical solutions Validation of numerical solutions Forcing SFA MOFLUX Web implementation CDIAC Data synthesis Data harvest and management LeafWeb support structure
Data collected from the user - Core variables - Variables to put the leaf in its environment User option of Share or not to share data Graphic capabilities Results to the user If the Share option is selected, the data are available to the general public; graphic function is enabled to the user If not to share, data and results are not archived, no graphic function Data flow through LeafWeb
C-LAMP • The Carbon-Land Model Intercomparison Project (C-LAMP) consists of an experimental protocol, model evaluation metrics, a prototype diagnostics package, model output standards, and a database of model simulation results on the Earth System Grid (ESG). See http://www.climatemodeling.org/c-lamp • In the first set of runs, over 16ky of simulation and 50TB of output were generated using the Climate Science End Station INCITE allocation at ORNL. • CLM3.1 (Community Land Model) combined with CASA´ (Carnegie-Ames-Stanford Approach) and CN (carbon & nitrogen) biogeochemistry modules were evaluated against best-available satellite- and ground-based measurements, and new runs are being used to evaluate CLM4 performance. • C-LAMP will serve as a benchmarking prototype for Intergovernmental Panel on Climate Change (IPCC) Fifth Assessment Report (AR5) in conjunction with ESG. Randerson, J. T., F. M. Hoffman, P. E. Thornton, N. M. Mahowald, K. Lindsay, Y. H. Lee, C. D. Nevison, S. C. Doney, G. B. Bonan, R. Stöckli, C. C. Covey, S. W. Running, and I. Y. Fung. “Systematic Assessment of Terrestrial Biogeochemistry in Coupled Climate-Carbon Models.” Global Change Biology, in press.
AmeriFlux Data Are An Important Component of C-LAMP • C-LAMP diagnostics include model comparisons with MODIS (Moderate Resolution Imaging Spectroradiometer) leaf area index (LAI) and net primary production (NPP), Globalview amplitude and phase, AmeriFlux Level 4 energy and carbon fluxes, Free Air CO2 Enrichment (FACE) site measurements, and various estimates of carbon stocks and transient dynamics. • Shown at right is a time series comparison of net ecosystem exchange (NEE), incoming shortwave, latent and sensible heat, gross primary production (GPP), and ecosystem respiration from CLM3.1-CN against measurements from the Morgan Monroe site. • C-LAMP diagnostics must be run before any model changes to the CLM biogeophysics or biogeochemistry can be made.