CFD Shape and Criteria Assessment

1. CFD Shape and Criteria Assessment TMAW – 6/15/04 Elgin Perry

2. A simulation of the CFD shows that the level of sampling affects the shape of the curve. Sampling error tends to make the observed curves (green) less steep that the true curve (red).

3. Simulation • Assume segment has 1000 cells. • Simulate values for the 1000 cells each day for 3 years. • Sample 10 cells once a month. • Interpolate from the 10 to the 1000. • Compare the CFD from sampling to the true CFD.

6. Solutions • Follow precedent and ignore problem. • Require equal sampling for Reference and Assessment CFD. • Explore analytical tools to remove bias.

7. Proposed ModelXij = U + ai + bij i = 1, 2, . . . M and j = 1, 2, . . . N.a is temporal variance termb is spatial variance term

8. Plot Parameters

9. DecreasingMean

10. As the mean decreases, percent of noncompliance decreases in both the spatial and temporal dimension.

11. Increasing Temporal Variance

12. Increasing Temporal Variance

13. As temporal variance increases, there is a higher frequency of events where a large portion of the segment is out of compliance.

14. Increasing Spatial Variance

15. Increasing Spatial Variance

16. As spatial variance increases, there is a higher frequency of a small portion of the segment being out of compliance.

17. Increasing Both

18. Increasing Both

19. If both spatial and temporal variance increase, the effect is about the same as increasing the mean toward the criterion.

20. Sampling Distribution

21. Sampling Distribution

22. Under this nested model, the sampling distribution (green step function) is flatter than the true CFD (red curve). This analytical finding seems to confirm the findings of the simulation (compare to slide 3).

23. What we have: Tool that links CFD to mean, temporal variance and spatial variance Tool to adjust CFD for sampling. What we need: Review of tools by a Math Stat type Model for effect of interpolation Summary

24. Addendum Oct. 7, 2004 Elgin Perry

25. New Developents • Narcheel Nagaraj and Bimal Sinha of UMBC are looking at problem. • They are not impressed with my nested model. • The feeling is mutual. • Nagaraj suggests a post Kriging bootstrap approach to quantifying the sampling distribution of the CFD.

26. Post Kriging Bootstrap • For each sampling date, estimate a Krig surface. • In the cells where there are observed data, compute the residual. • Pool these residuals over dates, to form a large population of residuals.

27. Post Kriging Bootstrap • For each date, resample from the pooled residuals once for each cell. Compute a bootstrap estimate for each cell as the sum of the original estimate and a residual. • Repeat the bootstrap procedure for each sample date. The compute a bootstrap CFD. • Repeat this 1000 times to form a population of CFD’s. • From this population, obtain a confidence envelope for the CFD.

28. Implementation Problems • Most implementations of Kriging “honor the data”. More like interpolation. • There are Kriging equations that do not require this. Would require special code.

32. Conclusion(s) • Needs more work.