320 likes | 425 Views
Designs for estimating variability structure and implications for detecting watershed restoration effectiveness. David P. Larsen Western Ecology Division, NHEERL, USEPA 200 SW 35 th St. Corvallis, OR 97333 N. Scott Urquhart Department of Statistics Colorado State University
E N D
Designs for estimating variability structure and implications for detecting watershed restoration effectiveness • David P. Larsen • Western Ecology Division, NHEERL, USEPA • 200 SW 35th St. Corvallis, OR 97333 • N. Scott Urquhart • Department of Statistics • Colorado State University • Ft. Collins, CO 80523
Topics • Linear trend detection • Applying the tools to restoration monitoring • Organizing variability • Expanding the linear trend detection model • Variance summary • Trend detection
A 2% per Year Linear Trend (each point is a regional mean value) For any patterned trend, there is an underlying linear component. 2% / yr Increase ( Slope = 0 ?)
A 2% per Year Linear Trend (each point is a regional mean value) Can we detect a difference is slope between “treated” and “untreated” systems? Treatment Reference
Linear trend detection • Hypothesis test: Slope = 0? • Power: If a trend is present, what is the likelihood of detecting it? • Hypothesis: Slope between treated and reference = 0 • Power: likelihood of detecting if different?
Linear trend detection • Power depends on: - magnitude of the trend (slope), - variability of our measurements, - number of sites, - the duration of the study (how long we can wait for the information).
Variance of a trend slope: How precisely can we estimate it?
Organizing Variability • Four major components: • Spatial • Site-to-site • Temporal (year to year) • Year • Site x Year Interaction • Residual
----------Stream Size -----------> . “SITE” VARIANCE: Persistent Site-to-Site Differences due to Different Landscape/Historical Contexts Different Levels of Human Disturbance ------ Gradient -------->
Year variation • Concordant year-to-year variation across all sites • Caused by regional phenomena such as: • Wet/Dry years • Ocean conditions • Major volcanic eruptions
Interaction variation • Independent year-to-year variation among sites • Driven by local factors
Residual variation • The rest of it including: • Temporal or seasonal variation during sampling window • Fine scale spatial variation • Crew-to-crew differences in applying the protocol • Measurement error • …
Design framework • Multiple sites with revisits within and among years • Need a sample size of 30-50 to get reasonable estimate of variance, i.e., 30 – 50 sites; 30-50 revisits within year; at least 5 years with some sites visited annually, or at least in pairs of adjacent years.
AUGMENTED SERIALLY ALTERNATING SERIALLY ALTERNATING WITH CONSECUTIVE YEAR REVISITS
Variance of a trend slope(New sites each year) residual interaction year site Xi = Year ; Ns= Number of sites in region; Nv= Number of within-year revisits (Urquhart and Kincaid. 1999. J. Ag., Biol., and Env. Statistics 4:404-414)
residual interaction year Variance of a trend slope(Revisiting the same sites each year) Xi = Year ; Ns= Number of sites in region; Nv= Number of within-year revisits (See Urquhart & Kincaid, 1999)
Implications • Effect of site = 0 if sites are revisited across years • Year is not sensitive to “sample size”and its effect can become dominant • Residual is affected by within year revisits • Interaction and residual are affected by number of sites in survey, therefore other factors being equal, better to add sites to the survey rather than revisit sites
Some options(after adding sites doesn’t help) • Extend survey interval • Focus on subpopulations to manage variance • Monitor hypothesized covariates controlling “year”
Adaptations for Effectiveness Monitoring • Context • Comparing two watersheds
Adaptations for Effectiveness Monitoring • Context • Comparing multiple watersheds • Some treated ( ) • Some reference ( )
Power to detect a 2% per year “drift” from reference? Indicator Year
residual interaction site Variance of the difference in two trend slopes(New sites each Year) Xi = Year ; Ns= Number of sites in each region; Nv= Number of within-year revisits
residual interaction Variance of the difference in two trend slopes(Revisiting the same sites Each Year) Xi = Year ; Ns= Number of sites in each region; Nv= Number of within-year revisits
Design for power curves • Annual visits, # sites varies • Serially alternating design, with annual panel • Variance components values were selected as low and high for Log10(LW+0.1) • Alpha = 0.1
POWER YEAR POWER CURVES FOR LOW VALUES OF VARIANCE COMPONENTS
POWER YEAR POWER CURVES FOR HIGH VALUES OF VARIANCE COMPONENTS
POWER YEAR POWER CURVES FOR HIGH VALUES OF VARIANCE COMPONENTS; AUGMENTED ROTATING PANEL DESIGN
Summary • Characterization of spatial and temporal variation • Design framework for estimating components of variation • A framework for evaluating linear trend • How variation affects trend detection • Modifying the framework for evaluating restoration • An example using large wood as an indicator