INITIALIZATION AND ONGOING ACCEPTANCE TESTING

1. INITIALIZATION AND ONGOING ACCEPTANCE TESTING

2. In order to use the contractor’s test results for acceptance and payment, ODOT must ensure that the contractor’s test results compare favorably with their own. Favorable comparability will be determined by means of paired testing of split samples.

3. INITIALIZATION TESTING • Minimum of 10 tests • Include plant start-up testing • 1st Lot testing divided into 10 sublots • Optionally, initialization can be made up of the first 2 lots of 5 sublots

4. INITIALIZATION TESTING Each set of asphalt testing includes: • 1 AIR VOID TEST • 1 AC CONTENT TEST • 3 ROADWAY DENSITY TESTS

5. At the conclusion of the sampling and associated testing, a statistical “paired-t test” will be performed by ODOT using the pairs of initialization test data.

6. If there is a significant bias: ODOT’s test results will be relied upon until the source of the bias has been identified and corrected. The lack of bias must then be validated by further “paired-t testing”

7. If Independent Evaluation requested: The Contractor may request evaluation of the testing bias via three-way split sample testing with an independent laboratory. ODOT will select the independent laboratory. All initialization testing will be performed by all three laboratories using split samples.

8. If ODOT testing shows a significant bias: • The Contractor will not be held responsible for any additional costs incurred by ODOT in conjunction with the 3-way split-sample testing • The Contractor’s test results will be relied upon for acceptance and pay adjustments

9. If Contractor testing shows a significant bias: • The Contractor shall reimburse ODOT for any additional costs incurred by ODOT in conjunction with the 3-way split-sample testing • ODOT’s test results will be relied upon for acceptance and pay adjustments

10. If paired-t testing validates the Contractor’s test methods, the Contractor’s test results will be used for acceptance and pay adjustment subject to: • ODOT will perform ongoing testing at a minimum frequency of 1 independent test per lot. • Ongoing process verification over time will be performed using the F-test and the t-test.

11. If ODOT’s testing-bias Control Charts indicate an out-of-control condition for testing bias: Both the Contractor and ODOT will immediately investigate the probable cause.

12. If the probable cause is identified and corrected or if the resulting bias is, in ODOT’s judgment, not likely to exceed the Allowable Testing Bias: Acceptance and pay adjustments will continue to be based on the Contractor’s results At ODOT’s discretion, errant test results may be discarded. If replacement test results are available, they may be substituted for discarded test results

13. If the probable cause is not corrected or if the resulting bias is, in ODOT’s judgment, likely to exceed the allowable testing bias: All subsequent testing will be paired testing until the source of the unaccepatable testing bias is corrected. During this period, acceptance and pay adjustments will be based on ODOT’s test results.

14. GUIDELINES FOR INITIAL VALIDATION OF CONTRACTOR’S TEST METHODS • A paired test shall consist of 2 separate tests by ODOT and the Contractor on a split sample

15. PAIRED TESTING On split samples test: • Air Voids • Asphalt Cement Content For Roadway Densities, perform paired tests on the same cores. The first lab to test the cores should make sure to oven-dry the cores at 140°F instead of 230°F

16. GENERAL PROCEDURE STEP 1 U Calculate , the average of the differences between the paired tests

17. Xp = The average of the difference between paired tests Where: np = Number of paired tests Xc = The Contractor’s individual test result for each sample. Xd = ODOT’s individual test result for each sample.

18. GENERAL PROCEDURE STEP 2 U Calculate Sp, the standard deviation of the differences between the paired tests

19. Where: Sp = The Standard Deviation of the difference between paired tests, np - 1 = Degrees of freedom, and Xc, Xd, np, and Xp as previously defined.

20. GENERAL PROCEDURE STEP 3 U Calculate tp, the paired-t test statistic

21. Where: tp = The paired-t teststatistic, and np, Xp, and Sp as previously defined. The vertical lines on either side of the equation indicate the need to take the ABSOLUTE VALUE of the equation Simply put, if the result of the calculation is NEGATIVE, change it to a POSITIVE number

22. GENERAL PROCEDURE STEP 4 U Obtain the critical t-value, tcrit, from Table 1 in Appendix A using np-1 degrees of freedom

23. GENERAL PROCEDURE STEP 5 U Compare the calculated paired-t statistic (tp) to the critical t-value tcrit U If tp is less than tcrit, there is no statistically significant bias U If tp is more than tcrit, there is a statistically significant bias

24. Compare the testing bias (Xp) to the associated allowable testing bias (ATB) from the table in Appendix A: If tp is more than tcrit : AC Quality Char. ATBUnits AC Content ± 0.15 % by weight Air Voids ± 0.50 % by volume Roadway Density ± 0.50 % of Gmm Note: ATB’s for aggregates are for control charts and information only.

25. If the magnitude of Xp is less than the magnitude of the corresponding ATB, the Contractor’s bias is statistically, but not practically significant. Contractor test results shall then be relied upon for acceptance and pay adjustments

26. If the magnitude of Xp is greater than or equal to the magnitude of the corresponding ATB, the Contractor’s bias is practically significant and unacceptable. Contractor test results shall not be relied upon until certified by a qualified independentcalibration specialist and validated through further paired-t testing.

27. TEST # 1 3.9 4.1 2 4.2 4.4 3 5.4 4.9 4 6.0 5.8 5 5.0 5.1 6 4.8 4.5 7 3.7 3.9 8 5.1 5.4 9 4.7 4.9 10 4.7 4.5 EXAMPLE - % Air Voids Xc Xd

28. Step 1 – Average Differences TEST # 1 4.1 2 4.2 3 4.9 4 5.8 5 5.0 6 4.8 7 3.7 8 5.1 9 4.9 10 4.5 Xp =-0.1 Xc Xd Xc - Xd 3.9 0.2 4.4 -0.2 5.4 -0.5 6.0 -0.2 5.1 -0.1 4.5 0.3 3.9 -0.2 5.4 -0.3 4.7 0.2 4.7 -0.2

29. Step 2 – Standard Deviation (Xc - Xd - Xp)2 Xc - Xd Xp Xc - Xd - Xp TEST # 0.2 0.3 0.09 -0.2 -0.1 0.01 1 -0.1 -0.5 -0.4 0.16 2 -0.1 -0.2 -0.1 0.01 3 -0.1 -0.1 0.0 0.00 4 -0.1 0.3 0.4 0.16 5 -0.1 -0.2 -0.1 0.01 6 -0.1 -0.3 -0.2 0.04 7 -0.1 0.2 0.3 0.09 8 -0.1 -0.2 -0.1 0.01 9 -0.1 S 10 -0.1 (Xc - Xd - Xp)2=0.58

30. Sp= 0.25386

31. tp= 1.246

32. Degrees of Critical Freedom (np – 1) t-value (tcrit) 2 9.925 3 5.841 4 4.604 5 4.032 6 3.707 3.499 7 3.355 8 3.250 9 3.169 10

33. tp= 1.246 < tcrit = 3.250 Since tp < tcrit, there is no statistical bias. Therefore the contractor’s tests on this quality characteristic are valid and will be relied upon for acceptance and pay adjustments.

34. ONGOING VALIDATION OF CONTRACTOR’S TEST METHODS

35. GUIDELINES FOR ONGOING VALIDATION OF CONTRACTOR’S TEST METHODS • Ongoing process verification over time will be performed using the F-test and the t-test. • The F-test provides a method for comparing the variances of the two data sets. • The t-test provides a method for comparing the means of the two data sets.

36. Contractor Department One independent Contractor: Collect samples to split and test ¼, discard ¼, store 2nd half. ODOT: Collect one sample per lot, independent of Contractor’s samples. Test ¼, discard ¼, store 2nd half.

37. GUIDELINES FOR ONGOING VALIDATION OF CONTRACTOR’S TEST METHODS • First two lots do not yield enough data for F-test and t-test. • These lots will be validated by comparing to D2S limits. • If │Xc – Xd │≤ D2S limit, assumed from same population – Contractor’s accepted. • If │Xc – Xd │> D2S limit, assumed from different populations – ODOT’s used.

38. D2S LIMITS

39. THIRD - FIFTH LOT AFTER INITIALIZATION • Using the F-test and t-test for process verification. • Use all data after Initialization, including that used for D2S comparisons. • By third lot after Initialization there should be 15 contractor results and 3 ODOT results.

40. SIXTH LOTS & FOLLOWING AFTER INITIALIZATION • Still using the F-test and t-test for process verification. • Use the current lot results plus the previous four for a total of five lots. • Each of these analyses should include 25 contractor results and 5 ODOT results.

41. Xc = the mean of the Contractor’s results Xd = the mean of the Department’s results F-test • Calculate the mean of each test set. Xc = individual Contractor result nc = the number of Contractor results Xd = individual Department result nd = the number of Department results

42. = the variance of the Contractor’s results F-test • Calculate the variance of each test set. nc - 1 = degrees of freedom of Contractor results = the variance of the Department’s results nc - 1 = degrees of freedom of Department results

43. F-test • Calculate the F-statistic. or Use the larger of the variances in the numerator so that the F-statistic is always greater than one.

44. F-test U Determine Fcrit from the F-distribution table using a 0.01 significance level U Compare the calculated F-statistic to the critical F-value Fcrit U If F is less than Fcrit, the data is assumed from the same population. U If F is more than Fcrit, the data is assumed from a different population

45. t-test • Calculate the pooled variance, . Where nc + nd - 2 = pooled degrees of freedom

46. t-test • Calculate the t-statistic.

47. t-test U Determine tcrit from the t-distribution table using a 0.01 significance level and the pooled degrees of freedom U Compare the calculated t-statistic to the critical t-value tcrit U If t is less than tcrit, the data is assumed from the same population. U If t is more than tcrit, the data is assumed from a different population

48. Both the F-test and the t-test must show the results to be from the same population to continue accepting the Contractor’s results

49. If either test shows the results to be from different populations, ODOT will test the remaining half of the Contractor’s split samples for acceptance until the reason for the difference is resolved.

50. EXAMPLE - % Asphalt Content 1st Lot after Initialization – D2S Limits After initialization, ODOT and Contractor samples are no longer split samples but obtained independently