150 likes | 166 Views
Explore the intricacies of data assimilation algorithms with a focus on Ensemble Kalman Filter and Bias formulations. Uncover the importance of model understanding within the assimilation box. Learn about techniques, challenges, and crucial insights for effective assimilation processes.
E N D
Data Assimilation Theory CTCD Data Assimilation Workshop Nov 2005 Sarah Dance
Data assimilation is often treated as a black box algorithm OUT Analysis IN Observations and a priori information (apologies to Rube Goldberg) BUT, understanding and developing what goes on inside the box is crucial !!
Formulations of the Ensemble Kalman Filter and Bias MSc thesis by David Livings, supervised by Sarah Dance and Nancy Nichols
Outline • Bayesian state estimation and the Kalman Filter • The EnKF • Bias and the EnKF • Conclusions
Prediction (between observations) e.g. Suppose xk = Mxk-1+ M is linear, the prior and model noise are Gaussian P(xk-1) ~ N(xb, P) ~ N(0, Q) Then P(xk |xk-1) ~N(Mxb, MPMT+Q)
At an observation we use Bayes rule Prior Background error distribution Likelihood of observationsObservation error pdf Bayes rule
The Kalman Filter • Use prediction equation and Bayes rule • Assume linear models (forecast and observation) • Assume Gaussian statistics • Kalman filter BUT • Models are nonlinear • Evolving large covariance matrices is expensive (106 x 106 in meteorology) • So use an ensemble (Monte Carlo idea)
= = =
Results with ETKF (old formulation) and Peter Lynch’s swinging spring model N=10, Perfect observations Red ensemble mean Blue ensemble std. Error bars indicate obs std. Ensemble statistics not consistent with the truth!
Bias and the EnKF • Many EnKF algorithms, can be put into a “square root” framework. • Define an ensemble perturbation matrix: So, by definition of the ensemble mean
Square-root ensemble updates • The mean of the ensemble is updated separately. • Ensemble perturbations are updated as • where T is a (non-unique) square root of an update equation. • Thus, for consistency, • David discovered that not all implementations preserve this property. • We have now found nec. and suff. conditions for consistency.
Consequences • The ensemble will be biased • The size of the ensemble spread will be too small • Filter divergence is more likely to occur ! • Care must be taken in algorithm choice and implementation