1 / 21

Validating the Prognosis DDS model for the Inland Empire

Validating the Prognosis DDS model for the Inland Empire. Robert E. Froese Andrew P. Robinson School of Forest Resources Etc. Department of Forest Resources Michigan Technological University University of Idaho. Forest Biometrics Lab. Evaluation Verification Validation Corroboration

mblaylock
Download Presentation

Validating the Prognosis DDS model for the Inland Empire

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Validating the Prognosis DDS model for the Inland Empire Robert E. Froese Andrew P. Robinson School of Forest Resources Etc. Department of Forest Resources Michigan Technological University University of Idaho Forest Biometrics Lab

  2. Evaluation Verification Validation Corroboration Qualification Model testing is optimally the responsibility of the model user, who is in the best position to clearly state goals and objectives (Brand and Holdaway 1983; Robinson and Ek 2000) assessment would be simpler if model developers report extensive performance information, rather than leave it to model users to generate for themselves (Brand and Holdaway 1983) What is “validation”? X TESTING

  3. Purposes for model testing • Caswell (1976): modelling has two core purposes, prediction and understanding, which can be distinguished by interest in truth or reality • a simplistic example: • the statement “Y varies in the same direction as X” is embodied in the model Y = b0 + b1·X (b1>0); a test of the accuracy of the model may show it to be a poor predictor, while a test of the statement may corroborate it. • In other words, • does a model user care if the internal structures are truthful, as long as the model makes accurate predictions? • does the scientist care if the model makes accurate predictions, as long as the model is useful for testing hypotheses about the underlying system? • objectives must be clear in design, application and evaluation!

  4. A little bit about Prognosis • growth engine for the Forest Vegetation Simulator in the inland empire • collection of models - and a model framework • Increment • Mortality • Regeneration • Scheduling and many others

  5. The Inland Empire

  6. What’s inside Prognosis? • trees are grown in three dimensions • basal area growth • height growth • crown ratio • divided into two classes for modelling • in northern Idaho, large is> 7.62 cm DBH, or > 3 m tall; the others are small

  7. What’s inside Prognosis? • Probabilistic – keep track of sampling fraction • Stochastic – record tripling and random deviates • No Site Index – uses habitat type and other site descriptors 1/300 acre

  8. Wykoff’s 1990 basal area growth model The DDS model is the key driver for increment … because predictions are used directly or indirectly as predictors in other model sub-components DDS = DBH2t+10 - DBH2t but actually.. DDS = DBH2t - DBH2t-10 BAG = (π/4)·(DBH2t - DBH2t-10) DG = (DBH2 + DDS)0.5 - DBH ln(DDS) = f( SIZE +SITE +COMPETITION)

  9. the 1990 DDS model formulation • bi – coefficients estimated by ordinary least squares, of which: • b0 depends on habitat type and nearest National Forest • b2 depends on nearest National Forest • b12 depends on habitat type

  10. Objectives • Produce performance information • bias • Precision • Provoke and guide future development • examine performance against individual predictors • Examine the model as a scientific statement • does the model behave the way it should based on biological principles

  11. Not Objectives • Traditional hypothesis test for model bias • e.g., Ho is of no difference and Ha is of a difference • Arbitrarily small differences are detectable • Statistical significance is not practical significance • An alternative: see Andrew Robinson’s talk tomorrow!

  12. FIA Data • data from the USDA Forest Service -Forest Inventory and Analysis Program (FIA) • geographically extensive • (now) one National design, all forest land ownerships • but… plot locations are strictly confidential • unbiased sampling design • systematic random sample • one field location per 2,400 hectares • estimates of between and within-stand variability • cluster of 5 to 10 (old design) or 4 (new design) plots • retrospective measurements of growth

  13. Methodology • backdate FIA stand conditions following Wykoff’s (1990) rationale • Find diameter at t-10 for all trees, to calculate competition variables • Find height at t-10 for growth sample trees • generate predictions using the 1990 DDS model • For growth sample trees • Calculate a basal area increment prediction residual • Estimate volume increment and volume increment prediction residual

  14. Results, overall • 40,979 trees over 2,632 FIA field locations • for Basal Area Increment • mean increment is 111.6 cm2dec-1 • mean bias is 13.2 cm2dec-1 or 11.8% underprediction • bias SD is 76.8 cm2dec-1 or CV is 651% • for Volume Increment • mean increment is 44.5 m3ha-1dec-1 • mean bias is 1.2 m3ha-1dec-1 or 2.6% underprediction • bias SD is 11.6 m3ha-1dec-1 or CV is 966% • this means • 2,632 locations x 2,400 ha·location-1 x 1.2 m3ha-1dec-1= more than 7.6 million m3dec-1underprediction

  15. for Basal Area Increment

  16. By nearest National Forest

  17. for Volume Increment

  18. Trends with predictors

  19. Discussion • FIA data • comparable in size and geographic extent • can’t do (precise) spatial analyses • BIAS • Practically, 7.5 million m3 is meaningful • relative to SD, perhaps not meaningful • extrapolation • space, time • consequences • management for timber • management for non-timber • LOC is a problem

  20. Conclusions • The 1990 DDS model is not a particularly accurate predictor of forest growth, but it is relatively robust as a theoretical statement under substantial extrapolation in time and space • Model users may wish to apply a multiplier to the diameter increment model subcomponent • Model development in the future should re-evaluate LOC and look for alternatives

  21. Acknowledgements Funding provided by the USDA Forest Service RMRS-99541-RJVA and the University of Idaho Forest Biometrics Lab. This research was completed entirely using open source software. Special thanks to: • My major Professor, Dr. Andrew Robinson • Bill Wykoff, Moscow Forest Sciences Lab • Sharon Woudenberg and John Nelson, FIA Ogden, Utah.

More Related