Database: submission, status, future

1. Database: submission, status, future

2. Send data and receive email confirmation is not enough!!!! Remember to import or discard your variables!!

4. Status Looking to who submitted what…..

5. Status Main sites – LEVEL4 prod. Status Main sites

6. Associated Main sites

7. Status of General information and Soil Respiration files submission Soil Resp Gen file Soil Resp Gen file

9. NO (only partially)… • In the next weeks the Greengrass database will be incorporated in the Carboeurope IP database and processed. • We asked also the data from Carbomont without answer • We are waiting the data from the Siberian projects (from Eurasia-net to TCOS) • We will try also to obtain data from the Amazonian project from EU • Any other dataset is welcome Still without (partially)… Coming Coming We invite also the PIs to send their data and in particular the 2003 missed months!!!

10. Questions/discussion about the status?

11. Gapfilling intercomparison results

12. From the Gapfilling WS: Do we need more variables? Flag indicating if there are footprint problems (particularly for crop) Flags indicating the management LAI or NDVI or Vegetation height (crop and grass) NOTE! It is not a good solution to put simply qcFc = 2 because the qcFc are defined from Spoleto!

13. BUT What about “standard quality flags obtained from the raw data”? What about the corrections/checks applied to the raw data? What about the corrections implemented in your software? The database role in standardization • Storage correction whit Sc provided by the PI (NEE_or) and calculated from the CO2 concentration top of tower (NEE_st) • 2) Ustar threshold calculated centrally • 3) Spike filtering performed centrally • 4) Gapfilling performed centrally using the two best methods from the gapfilling intercomparison • 5) Partitioning in GPP and TER performed centrally Unfortunately not all the PIs are sending the correct quality flags. Many sites have all the data with qc=0, or with all qc=2. There are sites that are not applying the qc correctly and mix-up with ustar filtering or footprint How many of you provided these info correctly to the database? Are these information important?

14. BA – 3D – ConstTLag LD – 3D – AutTLag Setting Comparison LD BA

15. µmolCO2 m-2 s-1 Generally this has a small effect to the sums However can have effect on the single half hour

16. How to solve this problem? How to avoid these differences? Using the same software with exactly the same settings BUT We compared different software and they give very similar results with the same settings Using the exactly the same settings BUT Can we define a “right” set of corrections and settings? What about the uniqueness of the sites? Use what you want but tell me what you did… BUT How can you send these information to the database? How many of you sent the information about the 2D 3D or PF correction applied? How many of you are sending the updated versions of the GEN file?

17. The best would be to have a common software where: • The user could decide which correction to apply • There would be implemented all the possible corrections • The user could also propose and add new options/corrections • All the settings used would be summarized in a table as metadata • The output would be directly formatted to be uploaded in the DB But to work, this software should be: • As flexible as possible • Available for all the HW/OS platforms • Continuously updated • User friendly for not expert users And in particular: • FREE • OPEN SOURCE • COMMON PROPERTY (CarboeuropeIP, Fluxnet)

18. OPEN-SOURCE CODE SET-UP BASED ON “.ini”-files code: FORTRAN 77/90 Are you interested in developing a common “community owned eddy covariance software”? We started developing the structure of such a software and now it is ready for your input…

19. Graphical version available PROCESSING • Features a user-friendly GUI • Simple but less flexible ACQUISITION core: FORTRAN 77/90 GUI: C (LabWindows)

20. OTHER RAW DATA ACQUISITION SOFTWARE TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging .med FILES CE-IP STANDARD OUTPUT

21. Moncrieff et al., 1997 – Journal of Idrology Aubinet et al., 2000 – Advances in Eological Research Moncrieff et al, 2004 – Handbook of Micrometeorology Lee et al. 2004, Handbook of Micrometeorology Aubinet et al., 2000 – Advances in Eological Research Liu et al., 2001 – Boundary Layer Meteorolgy Webb et al., 1980 – Quart. J. R. Soc. Moncrieff et al., 1997 – Journal of Idrology Horst, 1997 – Boundary Layer Meteorology Aubinet et al., 2001 – Agricultural and Forest Meteorology Thomas and Foken, 2002 – Am. Meteorol. Soc. Foken and Wichura, 1996 – Agricultural and Forest Meteorology Foken et al., 2004 – Handbook of Micrometeorology warm thanks to the Eddy Covariance CE-IP Summer School(Wépion, July 10-21, 2006) organizers and speakers!! time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging

22. ACQUISITION SOFTWARE OTHER RAW DATA TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging .med FILES CE-IP STANDARD OUTPUT

23. ACQUISITION SOFTWARE all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation suitable format Schotanus and WPL correction Spectral correction headers, anemometer format, scaling factors, offsets, binary … Quality Check / Quality Flagging TRANSLATOR .med FILES CE-IP STANDARD OUTPUT

24. OTHER RAW DATA ACQUISITION SOFTWARE TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging .med FILES CE-IP STANDARD OUTPUT

25. OTHER RAW DATA ACQUISITION SOFTWARE TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation spike removal (*) mean, variances, co-variances amplitude resolution (*) (*) Vickers and Mahrt, 1997 – Jour. Atm. Ocean. Tech. Axis rotation drop-outs (*) Fluxes, u*, T*, z/L etc.. calculation absolute limits (*) Schotanus and WPL correction MODIFIED RAW DATA Skewness and Kurtosis (*) Spectral correction discontinuities (*) Quality Check / Quality Flagging unrealistic time-lag (*) angle of attack (*) non-steady horizontal wind (*) .med FILES .med FILES

26. OTHER RAW DATA ACQUISITION SOFTWARE TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging .med FILES CE-IP STANDARD OUTPUT

27. ACQUISITION SOFTWARE all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation Calculation of scalars / w co-spetra mean, variances, co-variances Calculation sens. heat / w co-spectrum Axis rotation Calculation of exper. transfer functions Fluxes, u*, T*, z/L etc.. calculation automatic or manual regression with a given function Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging If user wants to use the <exp> or <mix> spectral correction options.. .med FILES CE-IP STANDARD OUTPUT

28. OTHER RAW DATA ACQUISITION SOFTWARE TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction Spectral correction Quality Check / Quality Flagging .med FILES CE-IP STANDARD OUTPUT

29. OTHER RAW DATA ACQUISITION SOFTWARE TRANSLATOR all raw data selected datasets RAW DATA RAW DATA SCREENING PLANAR FIT SPECTRAL ANALYSIS time-lag detection and data alignment fluctuation calculation mean, variances, co-variances Axis rotation Fluxes, u*, T*, z/L etc.. calculation Schotanus and WPL correction passes plane coefficients to main prog for rotation angle calculation Spectral correction Quality Check / Quality Flagging calculates planar fit (bi-linear regression) of w vs u/v If user wants to use the <pf> option.. .med FILES CIP STANDARD OUTPUT

30. Some preliminary validation With EDIRE BA 3D With MASE LD 3D

31. WHERE WE ARE AND WHAT WE NEED.. THE SOFTWARE CURRENTLY SUPPORTS MANY OF THE FEATURES AND PROCESSING OPTIONS PRESENTED DURING THE SUMMER SCHOOL. NONETHELESS… • SOME CORRECTIONS, TESTS, OPTIONS ARE NOT YET IMPLEMENTED (EX: OGIVE TEST, FOOTPRINT TEST…) • SOME ANEMOMETER AND IRGA ARE ALSO NOT YET SUPPORTED • THE MODULE TO IMPORT RAW DATA FORM OTHER SOFTWARE READS NOW ONLY FEW DATA-TYPES • THE SW STILL NEEDS A THOROUGH VALIDATION • THE AVAILABLE GUI PRESENTLY RUNS ONLY ON WINDOWS (2000 and later) • .. AND SOME BUGS ARE TO BE FIXED!! 

32. FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy Different networks involved: CarboeuropeIP, Ameriflux, Fluxnet-Canada, LBA, CarboAfrica, OzFlux, TCOS Siberia, ChinaFlux, KoFlux, AsiaFlux, NECC, US-China Carbon Consortium Sponsors (not all confirmed): GTOS ILEAPS NASA DAO Global Carbon Project CarboeuropeIP Organizing Commitee: D. Baldocchi T. Boden P. Ciais B. Cook B. Law D. Papale M. Reichstein S. Running R. Valentini

33. FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy Dataset will be pre-processed in an harmonized way before the WS The workshop has been designed as a real hands-on data synthesis workshop It will be restrict to 30-50 people coming from the different regional networks Particularly scientists most interested in synthesis activities should participate This does not preclude valuable post-workshop intellectual input from non-participating scientists for the scientific papers and co-authorship The harmonized global dataset will be available to all the community for other synthesis works particularly for the many topics that will be not discussed at the WS

34. FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy Carboeurope-IP Ecosystem Component will participate to the synthesis All the datasets submitted to the CarboeuropeIP database will be included (only if with good quality) and the PIs will be part of the activity. If you don’t want that your data will be used in this activity please send us a note. Carboeurope will have 7-8 participants to the WS and we have to provide a list of about 12-15 names with topic of interest to the Organising Committeebefore November 30th, with if possible a good balance between experienced and young PostDoc-level scientists Based on the suggestions of all networks and in consultation with networks, the Organising Commitee will propose a final participant list before December 10th (in order to avoid gaps or overloaded topics).

35. FLUXNET Synthesis Workshop 2007 19-22 February 2007 – La Thuille - Italy First draft of the list: