470 likes | 610 Views
Some Previous Work On Model Sensitivity Analysis and Uncertainty Analysis at SFWMD successes, challenges and disappointments. Wasantha Lal. Initial Purpose of Sensitivity/Uncertainty Analysis.
E N D
Some Previous Work OnModel Sensitivity Analysis and Uncertainty Analysis at SFWMDsuccesses, challenges and disappointments Wasantha Lal
Initial Purpose of Sensitivity/Uncertainty Analysis • To make sure that model outputs (eg. NSM and SFWMM) are used appropriately when making important decisions • To understand which parameters are most critical for the model output • To understand implications of model resolution (eg. 2x2)
What causes uncertainty of model output forecasting uncertainty Operational uncertainty
In addition to output uncertainty, what else may affect decision making
Examples of decision making under uncertainty(from other disciplines) • Steel/concrete design codes using factors of safety – ACI, API • Standards for water/air quality - EPA • Flood risk assessment - FEMA
Model Unc. Work done at SFWMD • Uncertainty workshop, Louks and Stedinger, 1994 • First order method • (Monte Carlo) Latin Hypercube sampling method Report suggesting first order and LHS methods
Model Unc. Work done at SFWMD (cont.. 2) • NSM sens/uncert analysis- Lal • First order method • Rosenblueth method • Factorial design method • Latin Hypercube method (LHS) • Singular Value Decomposition (SVD) Sensitivity and uncertainty analysis of Natural System Model NSM 4.2, 1994 (report) Sensitivity and uncertainty analysis of a regional simulation model for the Natural System in South Florida, Proc. XXVII IAHR/ASCE Conf , 1997, San Francisco
First order method Sensitivity matrix
parameters observations
Singular Value Decomposition A=sensitivity matrix U,V=orthonornal mat Lambda=diagonal mat of singular values
U^T V^T
Parameter resolution Parameter correlation
Rosenblueth method Variance of the output
Model Unc. Work done at SFWMD (Cont.. 3) • Evaluation of NSM output uncertainty using SFWMM model results – Lal • Regression analysis • Spectral analysis • Other statistics of SFWMM output Evaluation of the NSM output uncertainty using SFWMM results
Model Unc. Work done at SFWMD (Cont.. 4) • Numerical errors of overland flow and groundwater flow models – Lal • Discretization errors • Computational errors Performance comparison of overland flow algorithms, ASCE (HY) 124(4) Numerical errors in groundwater and overland flow models, Water Resources Research, 36(5), 2000
Model Unc. Work done at SFWMD (cont.. 5) • SFWMM sensitivity/uncert analysis – Paul Trimble • First order method • SVD • Error analysis statistics Paul Trimble, An evaluation of the certainty of system performance measures generated by the South Dlorida Water Management Model, Masters Thesis, FAU, 1995
Model Unc. Work done at SFWMD (Cont.. 6) • Uncertainty and Sensitivity of Phosphorous Deposition, Ahn and James • Sensitivity analysis of the ELM, Fitz et al. • Uncertainty of spatial data for landscape modeling, Sklar • Numerous other works