240 likes | 400 Views
2010 Report on Oasis Data 2007-2010. Long Beach, CA September 13 -14, 2011 R. Darrell Taylor Raytheon. Executive Summary. Baselines have been established for 2007 – 2010 No Feedback data, changing metric Review Proposed revision to the CB Report Card. Agenda. OASIS Entries – Audits
E N D
2010 Report on Oasis Data 2007-2010 Long Beach, CA September 13 -14, 2011 R. Darrell TaylorRaytheon Long Beach, CA September 13-14, 2011
Executive Summary • Baselines have been established for 2007 – 2010 • No Feedback data, changing metric • Review Proposed revision to the CB Report Card
Agenda • OASIS Entries – Audits • OASIS Nonconformities • AS9100 Elements • Feedback • Monitoring Model
Entries – Audits Long Beach, CA September 13-14, 2011
Comparison of Entries 2007 -2010 • Entries: • 2007 – 5114 • 2008 – 5972 ^16% • 2009 – 6969 ^17% • 2010 – 7502 ^7.6% • -2011 – 3253 8/1/2011 Increase slowing down
SUR=Surveillance REC = Recertification INT = Initial Comparison of Types2007 -2010 2011 – 72%, 21 %, 7%
Standards Entered Into Database 38 AS9100C – 2010; 225 in 2011 as 05 8/1/2011
CRB Comments - 2010 • 2007 – 2010 Data baselined Going to Rolling Format
Nonconformities Long Beach, CA September 13-14, 2011
Pareto of Total Nonconformities Totals 2010 – 20,009 2009 -20,980 2008 -18,803 2007 – 14,957 2011 – 65% 2 or less
OASIS Ratio of Total Findings Identify CB’s in the bottom 5% writing nonconformities Violates Normal Distribution Strongest fit 3 Parameter Lognormal
Total - Comments • Field “Family of Standards” states ISO9001:2000 s/b 2008? • 35 (<.5%)Entries with N/A in Numbers, what does that mean? • 2 Initials, 1 surveillance, 32 recertification
Ratio Majors/Entries Totals 2010 – 1387 2009 -1135 2008 – 976 2007 - 870 On average, one Major is written every fifth audit – NOTE: Average down to .18 per audit for 2010 (1/5 audits) No Change in 2011 (.19) .22 for AS9100C audits
OASIS Ratio of Majors NOT Normal Distribution strongest 3 parameter loglogistic Identify CB’s in the bottom 5% writing majors
Ratio Minors/Entries Totals 2010 – 18,627 2009 -19,414 2008 -17,393 2007 –14,087 On average, 2.5 Minors are written every audit 2011 – down to 2.12 AS9100C – 3.18
OASIS Ratio of Minors NOT Normal Distribution Lognormal Distribution Identify CB’s in the bottom 5% writing minors
Evaluation of Audit Type INT, REC, SUR • Chi Squared Test returned a P-Value = 0.069
AS9100 Nonconformities Top 10 NO CHANGE Top Eight 2010 same as 2009 & 2008
Feedback Analysis ON HOLD 2010 average 103 per month 2009 average 112 per month 2008 average 110 per month As of June 6% of 2010 Feedback Responses still open
Certification Body Statistical Assessment Model ON HOLD General - 1 Criteria Feedback - 3 Criteria OASIS Results - 3 Criteria ANAB Performance -4 ANAB Audits - 6 Criteria
Threshold Violations • RMC & ANAB need to research • >6 • ANAB to report to RMC • 4-5 • ANAB to investigate • 2-3 • No Action • <2
CB Name: XXX -2011 ANAB Additional Comments