applying a decade of rcs calibration activity experience to the ir

1. Applying a Decade of RCS Calibration Activity Experience to the IR/Visible/UV Measurement Community Dr. Randy J. Jost Assistant Professor of Electrical & Computer Engineering Utah State University (435) 797-0789 randy.j.jost@usu.edu Roger W. Davis Consultant, DynCorp/CSC (301) 904-4627 Roger@DavisEmail.us

3. Introduction

4. Certification - Why? When you are up to your rear in alligators, it�s hard to remember your objective was to drain the swamp (moat) or �. Certification helps you to achieve the desired end result by understanding and documenting the �measurement alligators� a.k.a error sources.

5. Certification - What? Objective: Uniformly improve signature measurements across the EO/IR spectrum by all �measurement facilities� for all sponsors Method: Establish ISO-9000 Quality System within the EO/IR measurement community How: Standardize and document measurement processes & procedures

6. Certification - What? A Quality System: Within a Formal Structure, establish: Defined processes & responsibilities A means for evaluating effectiveness A means for making improvements Based on a Cultural Mindset that includes: All activities involved in generating the product* or service must be controlled to some extent, ideally in a systematic manner Every person & action affecting the quality of the product or service is a part of the Quality System

7. Certification - What? Preparation Educating, Assessing, Planning, Scheduling Documentation Define policies, objectives Develop/document procedures & work instructions Implementation Operate as documented, internal audits, corrective & preventive actions, management reviews External Assessment External evaluation & registration are optional Surveillance & Improvement On-going internal audits, continuous improvements

8. Certification - What? Key ISO Definitions: ISO-XX �Registered�: A company or sub-unit attests that it has met the relevant criteria for ISO-XX as determined by an internal �self inspection� review. (Sometimes called �self� certification) ISO-XX �Certified�: A company or sub-unit who is ISO-XX �Registered� is reviewed by a third party of peers (from other companies or other divisions) and that third party attests that the company does indeed meet the relevant criteria for ISO-XX ISO-XX �Accredited� : Company is reviewed by an independent organization/firm/company who specializes in ISO-XX compliance. (I.E. reviewers are full-time specialists). Company is �accredited� if this firm attests they meet the relevant criteria for ISO-XX.

9. Certification - What? Key ISO Definitions: ISO-XX �Registered�: A company or sub-unit attests that it has met the relevant criteria for ISO-XX as determined by an internal �self inspection� review. (Sometimes called �self� certification) ISO-XX �Certified�: A company or sub-unit who is ISO-XX �Registered� is reviewed by a third party of peers (from other companies or other divisions) and that third party attests that the company does indeed meet the relevant criteria for ISO-XX ISO-XX �Accredited� : Company is reviewed by an independent organization/firm/company who specializes in ISO-XX compliance. (I.E. reviewers are full-time specialists). Company is �accredited� if this firm attests they meet the relevant criteria for ISO-XX.

10. Certification - What? Registered : Incurs 80+% of sunk cost and effort Certification: Most of the Technical Benefit comes from the third party peer review Different perspective offered by reviewers Reviewers have a wealth of experience to share (add value) If you can�t explain a process properly to a reviewer, chances are the process needs clarification (feedback). If reviewer(s) rate a practice �unsatisfactory� they are required to provide written comments so range becomes satisfactory! (Goal: Pass, not fail) Certification Effort protects proprietary / competitive interests ANSI-Z-540 review process is confidential�only the final certification compliance report is available to customers �Corrective actions� need not be shared once implemented (Embarrassment factor is understood and respected)

11. Certification - What? The term �CERTIFICATION,� as used in the DoD demonstration program and RCS community (in the sense of a facility being �certified�), is defined as having successfully completed a detailed review, of an RCS Range Book1 by a peer review committee using published evaluation criteria2. 1 Written in accordance with the quality documentation standard: � RCC/SMSG Report 804-01� 2 Evaluation Criteria are in the appendix of RCC Report 804-01

12. Certification - What? Detailed review and compliance assessment that a range has met the relevant quality assurance documentation standard for ANSI Z-540 Certification is: A Review committee�s positive assessment of compliance with the ANSI-Z-540 standard An endorsement of the range�s measurement processes �Deliverable� Documentation Package is the Range Book Certification is NOT: A rating system A review committee endorsement of day-to-day quantitative capabilities (accuracy, uncertainty, etc)

13. Key Differences Between RCS and EO/IR Communities

14. Key Differences Between RCS and EO/IR Communities

15. Key Differences Between RCS and EO/IR Communities

16. Building a Range book for the EO/IR Community

17. Building a Range book for the EO/IR Community

18. Building a Range book for the EO/IR Community

19. Building a Range book for the EO/IR Community

20. Building a Range book for the EO/IR Community

22. Report of Measurement /Uncertainty Analysis

23. Report of Measurement Contents

24. Moving Forward as a Community

25. Moving Forward as a Community

26. Moving Forward as a Community

27. Moving Forward as a Community

29. Recommendations

30. Summary

31. Summary

32. References

33. Concluding Thought

34. Backup Slides

42. Why Facility Tailoring is the Keyor Consequences of Not Using Common SenseorThe Dangers of Extrapolation

43. For More Information