1 / 43

Presentation Structure 1.Introduction 2. DoW 60 and 18 month 3. Information from Partners

WP5.5: Evaluation of seasonal-to-decadal scale impact-models forced with downscaled ERA-40, hindcasts and gridded observational datasets. Andy Morse, University of Liverpool A.P.Morse@liv.ac.uk This presentation contains slides from RT5 WP5.5 partners

oriana
Download Presentation

Presentation Structure 1.Introduction 2. DoW 60 and 18 month 3. Information from Partners

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP5.5: Evaluation of seasonal-to-decadal scale impact-models forced with downscaled ERA-40, hindcasts and gridded observational datasets. Andy Morse, University of Liverpool A.P.Morse@liv.ac.uk This presentation contains slides from RT5 WP5.5 partners Andy Morse and Anne Jones, University of Liverpool, Mark Liniger and Christof Appenzeller, MeteoSwiss, Andrew Challinor, Tom Osborne, Julia Slingo and Tim Wheeler, University of Reading, Laurent DUBUS, Clarisse FIL-TARDIEU and Sylvie PAREY, EDF Giampiero Genovese, Fabio Micale, Pierre Cantelaube , Jean-Michel Terres, EU-JRC Vittorio Marletto, ARPA Simon Mason and Madeleine Thomson, IRI, Columbia University

  2. Presentation Structure 1.Introduction 2. DoW 60 and 18 month 3. Information from Partners

  3. WP6.3 vs. WP 5.5? WP6.3 production of model runs, issues connected to downscaling and bias correction, use of impacts models within ensemble prediction system. WP5.5 is the validation of both the reference forecast data (e.g. ERA-40) and the EPS hindcasts and the validation of the impacts model against reference forecasts, forecasts from other gridded data and real observations e.g. crop yields Multi-tier validation

  4. DoW review Primary Objective O5.e: Evaluation of the impacts models driven by downscaled reanalysis, gridded and probabilistic hindcasts over seasonal-to-decadal scales through the use of application specific verification data sets. Scientific/Technical Questions What’s the quality of impact models at seasonal time scales?

  5. WP5.5 Objectives 60 months WP5.5: Evaluation of seasonal-to-decadal scale impact-models forced with downscaled ERA-40, hindcasts and gridded observational datasets. Leader: UNILIV (Morse). Participants: UREADMM (Wheeler/Slingo), ARPA-SIM (Marletto), JRC-IPSC (Genovese/Micale), METEOSWISS (Liniger/Appenzeller), LSE (Smith), IRI (Thomson/Mason), EDF (Dubus/ Fil-Tardieu/Parey), DWD (Biermann {Becker}). WHO (Menne), FAO (Gommes), WINFORMATICS (Norton) Key Objectives: assess skill-in-hand for a number of impact models 1. Run models appropriately downscaled ERA-40 data and gridded datasets developed in WP5.1 2. Run models with fully downscaled and bias corrected probabilistic ensemble hindcasts at seasonal to-decadal scales from WP6.3. Models include agriculture models (crop yield models for Europe and the tropics, agri-environmental impact models), infectious tropical disease (malaria and meningitis) and energy demand.

  6. Major milestone 5.5 by month 60 Evaluation of forecast skill of seasonal-to-decadal scale impacts-models when driven with ENSEMBLES EPS. Expected results and achievements: Assessment of the skill-in-hand for a number of impact models run with downscaled ERA-40 data, gridded observational datasets and fully downscaled and bias corrected probabilistic ensemble hindcasts at seasonal-to-decadal scales. Expected deliverable: Evaluation report on the forecast skill of seasonal-to-decadal scale impacts-models.

  7. Tiers of Validation from Morse, Doblas-Reyes, Hoshen, Hagedorn and Palmer (2005) Tellus (in press)

  8. WP5.5 Tasks 60 months Task 5.5.a: Assess ERA-40 reanalysis key impacts driver variables - parts of Europe, India and Africa. Gridded data from stations and satellites. Tier-0 Task 5.5.b: Evaluate forecast quality key variables probabilistic hindcasts - at appropriate impacts scales - links WP5.3. Key question - capture of seasonal cycles. Links to downscaling and bias correction work from other WPs – and links WP 6.3. Tier-1 Task 5.5.c: Skill of the impacts models driven by corrected (d/s b/c) probabilistic hincasts, compared with reference forecasts from a. downscaled ERA-40, b. other gridded data sets. Tier 2 Task 5.5.d: Impact model verified against real observations driven by a. ERA-40 reanalysis, b. other gridded data sets and c. probabilistic seasonal hindcasts. Tier-3

  9. Management Issues Attrition of partners – withdrawal three partners Two due to UN/EU contractual issues One (SME) due to commercial considerations Use of 6 month report Communication -monthly or bi-monthly newsletter?

  10. 18 Month Plan Participant id (person-months): UNILIV (2), UREADMM (9), ARPA-SIM (7), JRC-IPSC (2), METEOSWISS (1), LSE (2), IRI (1), EDF (1), DWD (1), WHO (3), FAO (1), WINFORMATICS (0). Objectives Evaluation of the impacts models driven by downscaled reanalysis, gridded and probabilistic hindcasts over seasonal-to-decadal scales through the use of application specific verification data sets.

  11. Tasks 18 months Headlines: Limited runs used to develop validation systems Health applications workshop either evaluation of the state of the art or on setting the agenda for future research Task 5.5.1: Seasonal application models tested ERA-40 data and selected models run DEMETER hindcasts development of validation systems. Task 5.5.2: A workshop on use of seasonal probabilistic forecasting for health applications Deliverables D5.10: Workshop report on Lessons learned from seasonal forecasting: health protection (month 18) Milestones and expected result : None in first 18 months

  12. Information from Partners Liverpool ARPA JRC Reading EDF Meteoswiss other partners

  13. Temperature Malaria Model: Temperature dependence Mosquito survival after Martens (1995) At T = 25°C sporogonic cycle length = 15.9 days 2.9% survive to infectious stage Analysis and diagram from Anne Jones

  14. Malaria Model comparison new dynamic and existing rules based models MARA Mapping Malaria Risk in Africa Prevalence = proportion of human population infected with malaria Slide 15 of 14

  15. Liverpool – malaria model output Brier Skill Scores Feb 2-4 and 4-6 LT is the lower tercile event, AM the above the median event and UT the upper tercile event 63 ensemble members against a reference forecast made with ERA-40. Data 1987 to 2002 grid points 17.5S 22.5E, 17.5S 25.0E, 17.5S 27.5E, 17.5S 30.0E After Morse et al. (2005) Tellus, in press

  16. reference runs 0 N(y-1)………J 1 2 3 J M J A M J Demeter ds output (P, T) Observations (P, T) Demeter evaluation runs General layout of the hindcast evaluation tests Wofost/ CRITERIA Vittorio Marletto, ARPA

  17. Vittorio Marletto, ARPA Figure xB. Box and whiskers distributions of predicted potential wheat yields (kg/ha) simulated using downscaled DEMETER daily hindcasts for the years 1977-1987 in a location near Modena. In the top graph the crop model was provided with observed weather data up to the 31st of March and supplemented with DEMETER downscaled hindcasts up to harvest date (end of June in Northern Italy). The above procedure was repeated but with observed data up to the 30th of April (centre) and to the 31st of May (bottom). DEMETER data refer to four models (CNRM, UKMO, SCWF, SMPI), 9 members and 2 downscaling replicates obtained by DMI using a weather generator. Potential wheat yields simulated by the Wofost/Criteria model with observed weather data only are also provided for comparison.

  18. JRC crop modelling results • Average (1995-1998) European weighted percentage error wheat yields • hybrid JRC modelling system and DEMETER full growing season crop model estimation. • JRC hybrid WOFOST based crop model run observed meteorological data (to date) with • crop yield statistical estimation crop growth indicators. • DEMETER ensemble driven WOFOST forecast February start date 180 days 63 members. • Results Portugal excluded systematic bias. • Results weighted on proportional contribution each member state. • Percentage error obtained DEMETER end of February lies between average error end June & August JRC operational system. • Demonstrates ability DEMETER make forecast earlier in season than current methods. After Cantelaube P., Terres J.M. (2005) Tellus submitted

  19. Ensembles WP5.5. Simulation of the yield of groundnuts across India using the GLAM crop model and the ECMWF ERA40 reanalysis Correlations between observed yield (left), or modelled yield (right), and ERA40 rainfall May-Nov. Significance is shown by dots from Challinor et al., in press Andrew Challinor, Tom Osborne, Julia Slingo, Tim Wheeler

  20. RT5 : EDF/R&DLaurent DUBUSClarisse FIL-TARDIEUSylvie PAREY

  21. EDF/R&D topics of interest • Weather forecasts (RT5 contribution) Main aim : production facilities management at time scales • Daily to weekly • Monthly to annual • Decadal Needs and contribution • Spatial and temporal downscaling methods • Area of interest : France and Europe • Tests on electricity demand forecasting • Climate change (Interest for RT4 results, participation?) Impact on mean climate • Electricity production and consumption Impact on meteorological extremes • Dimensioning • Crisis management

  22. MeteoSwiss activities for WP5.5: Temperature based application models Example: Modeling swiss main variability in spring onset using growing degree days Spring phase (red/blue) Studer, S., Appenzeller, C., Defila, C, 2005:Clim. Change, in press. Liniger, Appenzeller 2005

  23. Other Partners DWD Kai Biermann, DWD and René Jursa, Institute of Solar Energy Technology (ISET) e.V. Kassel DEMETER ensemble members and wind power predictions linked by linear regression model LSE - Lenny Smith

  24. Key linkages • From WP 6.3 for • Timely and easy access to data – already in discussion RT1, RT2a, RT2b, RT3 and RT5 • Effective use of downscaling tools – already in discussion with RT2B, RT3 and RT2a • RT5 for validation – with WP6.3 and WP5.5 directly linked • Interest in RT4 findings • RT7 economic impacts • WP 5.5 specific WP 5.1 gridded data Europe, WP 5.3 forecast quality and WP5.2 systematic errors, WP 5.4 extreme events, RT7 economic impacts. • Possible links WP 4.3 extreme weather conditions, WP 4.2 Regional Climate Change – based on known impacts model thresholds etc.

  25. Questions?

  26. Malaria Model background to disease • Malaria kills more than 2,000,000 people per year • 90% deaths sub-Saharan Africa -mostly children • Mechanisms of the disease known for over 100 years • Anopheline mosquitoes and parasite Plasmodium spp. with P. falciparum most dangerous and cause of African epidemics

  27. Malaria Model malaria life cycle biting/laying: temperature dependent sporogonic cycle: temperature dependent larval stage: rainfall dependent Slide 30 of 14

  28. Cost-loss Ratios and Potential Economic Value – malaria transmission simulation Season MAM: Lead 2 to 4 months (Morse et al.2005 Tellus, in press) Upper tercile prevalence Data 1987 to 2002 grid points 17.5S 22.5E, 17.5S 25.0E, 17.5S 27.5E, 17.5S 30.0E

  29. Infectious Disease and Epidemics • Many infectious diseases, in the tropics, have a strong seasonal cycle related to the seasonal climatic cycles • Climatically anomalous years can lead to epidemics • Time between trigger threshold to epidemic peak often too short to take effective intervention – need for skilful and timely seasonal climate forecast Epidemic Cycle Vaccine Threshold Effect

  30. Selected Recent Papers Molesworth, A.M., Cuevas, L.E., Connor, S.J., Morse A.P., Thomson, M.C. (2003). Environmental risk and meningitis epidemics in Africa, Emerging Infectious Diseases, 9 (10), 1287-1293. Hoshen, M.B., Morse, A.P. (2004) A weather-driven model of malaria transmission, Malaria Journal, 3:32 (6th September 2004)  doi:10.1186/1475-2875-3-32 (14 pages) Morse, A.P., Doblas-Reyes, F., Hoshen, M.B., Hagedorn, R.and Palmer, T.N. (2005) A forecast quality assessment of an end-to-end probabilistic multi-model seasonal forecast system using a malaria model, Tellus A, ( in press)

  31. Sensitivity Testing Input Data Peak Mosquito Population Peak Prevalence b) Lag (days) a) Lag (days) Analysis and diagrams from Anne Jones • Varied driving data to investigate sensitivity of model to magnitude and timing of seasons • Interesting results were obtained by progressively lagging the temperature time series with respect to the rainfall time series • For southern Africa very sensitive to temperature • Relative timing is important Rainfall and temperature climatology for S28 grid point a) peak prevalence and b) mosquito population as a function of lag for grid point S28

  32. Adult mosquito daily survival as function of temperature Data source Bayoh, M. N., 2001 unpublished Ph.D. Processing and diagram from Anne Jones

  33. The Lag Example – W12 grid point climatology • West Africa – malaria is rainfall driven • mosquito population takes a long time to get infected from the small human reservoir • limited secondary infections Mosquito infection probability=1 (Unlimited human reservoir) -> immunity /chronic infection component in model (infectious until next rainy season) ??? Analysis and diagram from Anne Jones

  34. Brier Skill Scores Feb 2-4 and 4-6 LT is the lower tercile event, AM the above the median event and UT the upper tercile event After Morse et al. 2005

  35. DEMETER Seasonal Forecasting System • EU FP5 DEMETER – multi-model ensemble system www.ecmwf.int/research/demeter • Seven modelling groups running AOGCMs in full forecast mode, 4 start dates per year running out to 6 months, hindcasts 1959 to 2000 • Data available from data.ecmwf.int/data/ • EU FP6 ENSEMBLES www.ensembles-eu.org DEMETER - hindcast biases

  36. WP5.5 Evaluation of seasonal-to-decadal scale impact-models forced with downscaled ERA-40, hindcasts and gridded observational datasets. UNILIV (Morse), WHO (Menne), UREADMM (Slingo), ARPA-SIM (Marletto), JRC-IPSC (Genovese), METEOSWISS (Appenzeller), LSE (Smith), FAO (Gommes), IRI (Thomson), WINFORMATICS (Norton), EDF (Dubus), DWD (Becker). First 18 months: Seasonal application models will be tested with ERA-40 data and (selected models) with DEMETER forecasts to commence development of validation systems (requires downscaled ERA-40 and DEMETER data and bias corrected DEMETER data) working on Tier-2 (ERA-40 reference forecast) and Tier-3 (full validation) validation systems. Workshop on the use of seasonal probabilistic forecasting for health applications either 1. evaluation of the state of the art or 2. on setting the agenda for future research Beyond: For fields of interest at temporal and spatial scales of interest to impacts modellers- the validation of ERA-40 data against other gridded data as available, Tier-1 validation of DEMETER (downscaled) variables ERA-40 and other gridded data sets, impacts models driven with ENSEMBLES seasonal-to-decadal forecasts on Tier-2 (reference forecast) validation and Tier-3 (real observations –e.g. crop yield) validations

  37. ARPA crop modelling results • Wheat yields 1977-1987, Modena, Italy. • 72 ensembles (4 models (x9) x2) downscaling replicates • WOFOST based crop model observed data to 31st March and onwards with DEMETER hindcasts to harvest date (end June) • Box (IQR) whiskers (10th & 90th percentiles) • Observed weather simulation (control) solid triangle • Climatology based run hollow circle. After Marletto et al. (2005) Tellus submitted

More Related