170 likes | 181 Views
Explore the effectiveness of combining forecasts in meteorology using Bayesian techniques. Learn from pioneer Laplace to modern methods and application areas, and discover the Bayesian approach for improved outcomes. Gain insights into ensemble mean models and various combination techniques for better results in weather predictions.
E N D
Is a group of forecasts better than one? Caio A. S. Coelho Department of Meteorology, University of Reading Plan of talk • Introduction • Combination in meteorology • Bayesian combination • Conclusion and future directions
The Pioneer of combination Pierre-Simon Laplace (1749-1827) a residual slope • • • • • • • • • • • • • • • • • • p • Laplace (1818): Combination of two estimators
In modern times… Forecasts from + numerical = methods • • • Have combined forecasts better skill than individual forecasts?
Forecast combination literature • Trenkler and Gotu (2000): ~600 publications • (1970-2000) • Widely applied in Economics and Meteorology • Overlap of methods in these areas • Combined forecasts are better than individual forecasts
Some issues • What is the best method for combining? • Is it worth combining unbiased forecasts with biased forecasts?
DEMETER coupled model forecasts Nino-3.4 index (Y) Period: 1987-99 9 members Jul -> Dec 5 months lead ECMWF Meteo-France (MF) Max Planck Institut (MPI) DEMETER web page: http://www.ecmwf.int/research/demeter
Forecast combination in meteorology ensemble mean models combined forecast constants Linear combination of M ensemble mean forecasts X
Combination methods used in meteorology How to estimate wo and wi ? • Bias-removed multimodel ensemble mean forecast (Uem) • Regression-improved multimodel ensemble mean • forecast(Rem) • Regression-improved multimodel forecast (Rall) Kharin and Zwiers (2002)
The Bayesian approach Thomas Bayes (1701-1761) The process of belief revision on any event Y consists in updating the probability of Y when new information X becomes available Y: Observed December Nino-3.4 index X: Ensemble mean forecast of Y for December Likelihood:p(X=x|Y) Posterior:p(Y|X=x) Example: Ensemble mean (X=x=27C) Prior:p(Y)
Bayesian multimodel forecast (B) bias Prior: Likelihood: calibration Posterior:
Nino-3.4 index observational data Nino-3.4 index mean values: Jul: 27.1C Dec: 26.5C r: 0.87 July and December Reynolds OI V2 SST (1950-2001) R2 =0.76
All combined forecasts Why are Rall and B so similar? Uem Rem Rall B
Combined forecasts in Bayesian notation Bayesian combination Likelihood: Prior: B prior Rem and Rall prior
Skill and uncertainty measures Skill Score = [1- MSE/MSE(climatology)]*100%
Conclusions and future directions • Forecast can be combined in several different ways • Combined forecasts have better skill than individual forecasts • Rall and B had best skill for Nino-3.4 example • Inclusion of very biased forecast has not deteriorated combination • Extend method for South America rainfall forecasts