Procurement Quality Assurance

1. Procurement Quality Assurance HOW ARE WE DOING ? Quality Metrics for Aerospace Tim Robertson PQA NASA/JPL

2. Procurement Quality Assurance Quality Metrics for Aerospace While ISO 9000 emphasis was on the COMPLIANCE to the requirements, the focus of AS9100 is on the EFFECTIVENESS of the Quality System. In order to determine the effectiveness of a system, one must be able to measure the inputs and outputs of the system.

3. Procurement Quality Assurance Quality Metrics for Aerospace Psychology of Metrics • Results Based • Clear Objectives • Process and Product Focus • Focus on Numbers • Avoid Misuse

4. Procurement Quality Assurance Value of Information Cost of Acquisition Quality Metrics for Aerospace ROI of Metrics

5. Procurement Quality Assurance Quality Metrics for Aerospace Value of Information • Direct • Net Cost Reduction • Net efficiency improvement • Indirect • Quality Improvement • Risk Reduction

6. Procurement Quality Assurance Quality Metrics for Aerospace Cost of Acquisition • Incremental collection cost • Computation and manipulation • Interpretation of results

7. Procurement Quality Assurance Quality Metrics for Aerospace Analyzing Metrics Results • Model effectiveness • Telling the desired stories • Cost effective measurements • Data accuracy • Data consistency

8. Procurement Quality Assurance Quality Metrics for Aerospace The metrics matrix will be a value added tool of measurements from the top-level business process through design and engineering, into the manufacturing of products and installation and testing. Quality Metrics Tree

9. Procurement Quality Assurance Quality Metrics for Aerospace Systems Design The quality metrics matrix will have the ability to focus on the low hanging fruit as well the areas not as easy to reach Process Quality Metrics Tree

10. Procurement Quality Assurance System Level 1 Level 2 Design Level 3 Level 4 Process Level 5 Level 6 Quality Metrics Tree

11. Procurement Quality Assurance Level 1 Manufacturing Quality Engineering Finance Procurement Information Systems Management Example-Quality Metrics Tree Level One Quality Metrics identify top level measurables- for example: 1. Customer satisfaction rating on cost, timeliness, accuracy, or other key characteristics 2. Number of outputs for which customer requirements have been identified and defined 3. Number of customer complaints 4. Number of waivers to procedures per day/week/month

12. Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Welding Machining Material Processing Brazing Heat Processing Using Manufacturing as the Level One Process, the identified Level Two Process Metrics could include the following: 1. Percent reduction of elapsed process time (process time now vs. process time before) 2. Percent increase in flexibility (response time now vs. response time before) 3. Percent reduction of cost required to complete process (cost now vs. cost before) 4. Percent increase in accuracy (number of defect now vs. number of defects before) 5. Percent increase in timeliness (number of on-times now vs. on-time before) 6. Percent reduction in detection/correction costs (cost now vs. cost before) 7. Percent reduction of hands-on time required to complete process (hands-on time now vs. hands-on time before)

13. Level 1 Manufacturing Procurement Quality Assurance Level 2 Machining Example-Quality Metrics Tree Level 3 CNC Lathe CNC Mill Conv. Lathe Conv. Mill Deburr Using Manufacturing/Machining as the Level One and Level Two Processes, the identified Level Three Process Metrics could include the following: 1. Percentage of processes for which capability is established 2. Elapsed time vs. hands on time 3. Amount of hands on time (in hours) devoted to non-value added steps in: ·        Inspection, Rework, Duplicate approvals 4. Cost of non-value added steps (hands on time x costing rate) 5. Number of defects or errors in output (per hour/day/week/per unit/page/form) 6. Number of on-time deliveries (per schedule, contract, or promise date) 7. Cost of quality (cost of prevention activities + cost of detection/correction activities) 8. Machine Capability Studies

14. Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Aluminum High Strength Steel Nickel Alloys Titanium Beryllium Using Manufacturing/Machining/CNC Lathe Processes, the identified Level Four Process Metrics could include the following: • 1. Material Supplier Quality Data • 2. Material Certifications, i.e. chemical and physical • 3. Material Heat Lot

15. Procurement Quality Assurance Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Aluminum Example-Quality Metrics Tree Level 5 Drilling Boring Facing Turning Threading Grooving Using Manufacturing/Machining/CNC Lathe/Aluminum, the identified Level Five Process Metrics could include the following: 1. Percent reduction of elapsed process time (process time now vs. process time before) 2. Percent reduction of cost required to complete process (cost now vs. cost before) 3. Percent increase in accuracy (number of defect now vs. number of defects before) 5. Percent increase in timeliness (number of on-times now vs. on-time before) 6. Percent reduction in detection/correction costs (cost now vs. cost before) 7. Percent reduction of hands-on time required to complete process (hands-on time now vs. hands-on time before) 8. Process Capability vs. Product Tolerance measurement

16. Procurement Quality Assurance Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Material Type Level 5 Drilling Example-Quality Metrics Tree Level 6 Speed Feed Rate Drill Type Drill Material SFM Tool Holder Using Manufacturing/Machining/CNC Lathe/Aluminum/Drilling, the identified Level Six Process Metrics could include the following: 1. Process capability Studies with various type of drills 2. Process Capability Studies with various speeds and feeds 3. Inspection / Gage Capability

17. Procurement Quality Assurance Example-Quality Metrics Tree Level 1 Manufacturing Level 2 Machining Level 3 CNC Lathe Level 4 Material Type Level 5 Drilling Boring Facing Turning Threading Grooving Level 6 Key Process Parameters

18. Procurement Quality Assurance Quality Metrics for Aerospace The Quality Metrics initiative is to develop and implement a set of standardized metrics across the various NASA centers and laboratories. The development of a web based quality metrics matrix will allow for customers and suppliers to select the value added metrics for all areas of business.

19. Procurement Quality Assurance Quality Metrics for Aerospace The Quality Metrics Initiative is a JPL coordinated, NASA (soon to be sponsored) activity that will involve all NASA Centers and various Aerospace Companies in the development

20. Procurement Quality Assurance Quality Metrics for Aerospace Keys for Success • Understand the purpose of metrics • Focus on results • Objective measures • Knowledge acceptance and transfer • Clear, relevant metrics