Briefer: John Charles Angermayer ESC/GA Electronic Systems Center Hanscom AFB, MA

1. 2003 Major General Albert R. Shiely Jr. Award Winner Global Air Traffic Operations/MobilityCommand and Control (GATO/MC2)System Program Office Navigation Databases Briefer: John Charles Angermayer ESC/GA Electronic Systems Center Hanscom AFB, MA Date: 5 Oct 2004 “GA LEADS THE WAY”

2. Definitions • Accuracy - The degree of conformance between the estimated or measured value and its true value. • Resolution - The smallest difference between two adjacent values that can be represented in a data storage, display or transfer system • Correctness – Data meets stated quality requirements. • Integrity - The assurance that a data element retrieved from a storage system has not been corrupted or altered in any way since the original data entry or latest authorized amendment

3. Definitions (Cont.) • Process – The steps involved in achieving a goal or objective. (My own Definition) • Assurance – Obtaining the required degree of confidence in theability of a process or product to meet its stated requirements, that it is fit for its specified purpose. • Quality Management – Establishing and maintaining the required assurance in the process and product. • Essential Level Data– Failure conditions (i.e. using data of insufficient quality) that reduce capability of the aircraft or crew to deal with adverse operating conditions. • Timeliness - The degree of confidence that the data is applicable to the period of its intended use

4. Data Chain Software Developer (Tools) Aircraft Manufacturer State DAFIF DAFIF FMS NGA Operations Aircraft Specific Trusted Navigation Database Air Crew Data Chain Trusted Navigation Data

5. Feedback loop – (e.g. SSF) NGA Supplier Notams Combine State Data ‘States’ SPO FMS Data World Wide Checked World Wide MAJCOM State Data ● ● ● GATM’s Main Area of Interest for Processes and Tools Simplified Air Force Data Chain Wing or Squadron Unit Pilot -User Check World Data Format and Select Aircraft ● ● ● Trusted Trusted

6. How is Compliance Achieved • State Data • By definition correct • For navigation data, an approved supplier is either a State or a RTCA DO-200A/EUROCAE ED-76 compliant supplier.

7. How is Compliance Achieved (Cont.) • NGA Data • Uses State Data (Re-formats State Data) • Uses trained analysts and approved processes • Controls tools used • Uses only NGA internal systems • Tests tools • Ensures only approved tools are used • Ensures appropriate use of tools • Controls the release process and release timing • Does extensive data reasonableness checks during release process. • Uses CRCs • Quality Management

8. How is Compliance Achieved (Cont.) • Users • Training • Defined and approved processes are used • Only approved tools are used • Tool vendor • Achieved tool qualification – DO-200A section 2.4.5 • Uses an approved tool release process • Appropriate configuration management • Built required data control into tool • Built extensive data error reporting into tool

9. Feedback Loop • Problem reports can come from all parts of the Data Chain. • Have a working system for feedback in place • Main capture is at Hill AF and NGA • Main CM control is at Hill AF • Main decision makers are currently at AMC support by all stakeholders • Most problems flow into NGA • If NGA can correct the problem then it goes no further. • NGA still responsible for NOTAMS • Processes are in place between all stakeholders to ensure problems get recorded at Hill AF and that those problems are appropriately distributed to the stakeholders. • Process is in place to ensure all problems are answered.

10. Database is acceptable for specific essential operations. Data Chain is in compliance with DO-200A at essential level. Data delivered to the KC-135 aircraft has data resolution (number of digits) sufficient for essential use. Accuracy is sufficient across the data base to support the allowed essential operations. There is a working feedback system that can help measure and improve the correctness of the database. Process changes are not allowed within the data chain without a GATM audit and approval; Quality control is being locally improved. GATM Approval only involves database use in RNP 10 and RNP 4 airspace. What can be said about the GATM Approval.

11. What additionally should be said about the GATM Approval • The database is not approved as 100% correct • The database is not approved for all RNP operations • The database is not approved for use in RNP airspace on all Air Force aircraft • The database is not approved for critical navigation operations

12. Summary • Where do we go from here? • My current objectives • Educate database users on current feedback system • Monitor the current feedback system against it’s performance requirements • Let current feedback system measure the correctness of the database • Let current feedback system improve the correctness of the database • Improve Quality Management in the Data Chain • Maintain current compliance of the Data Chain to DO-200A

13. Summary (Cont.) • Other possibilities • Establish an allowable correctness value for the database depending on use? • Make a big push to find errors in the database and fix any problems found to meet correctness requirement?

14. Summary (Cont.) • Very difficult possibilities • Re-design the process • Implement the re-designed process?