1 / 15

CARE/ASAS Validation Framework

This validation framework provides a structured approach to demonstrate the ability of a deliverable to operate in a real-life environment, against pre-defined levels of functionality, operability, and performance. It includes process, strategy, and guidance materials for validation, as well as techniques such as analytical modeling, fast-time simulation, real-time simulation, and field testing. The framework focuses on ensuring consistency and comparability of validation across different ASAS categories.

thelmab
Download Presentation

CARE/ASAS Validation Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CARE/ASAS Validation Framework Ros Eveleigh Activity 2 Project Manager NATS

  2. What is Validation ? • More than Simulation & Analysis “The process through which a desired level of confidence in the ability of a deliverable to operate in a real-life environment may be demonstrated against a pre-defined level of functionality, operability and performance.”

  3. What is Validation “The process through which a desired level of confidence in the ability of a deliverable to operate in a real-life environment may be demonstrated against a pre-defined level of functionality, operability and performance.” • Process • Strategy • Guidance Materials

  4. What is Validation “The process through which a desired level of confidence in the ability of a deliverable to operate in a real-life environment may be demonstrated against a pre-defined level of functionality, operability and performance.” • Real-life environment • Scenarios • Operationally realistic, relevant, testing

  5. What is Validation “The process through which a desired level of confidence in the ability of a deliverable to operate in a real-life environment may be demonstrated against a pre-defined level of functionality, operability and performance.” • Functionality, operability & performance • Metrics • System performance, Human performance

  6. Survey Validation Strategy Idea Operations

  7. Validation Techniques • Analytical modelling • Fast-time simulation • Real-time techniques • Real-time simulation • Shadow mode • Operational trials • Survey

  8. Analytical Modelling • “High-Level Fast-Time” techniques • Back of envelope • Excel spreadsheets • Mathematical models • Often specifically developed to solve a particular problem • Quick turn-around

  9. Fast-Time Simulation • Relatively resource “light” • “limited” ATCO participation • small facilities • Models such as RAMS,TAAM, SIMMOD • Wide scope assessment • Time • Geographic extent • Relatively quick study time • Many scenarios

  10. Real-Time Simulation • Operator in the loop • Small scale and large scale • Resource intensive • ATCOs • pseudo-pilots • analysts • developers • engineers • Reduced scenario size • Raises awareness across ATC spectrum

  11. Field Test & Shadow Mode • Simulator installed and linked into ACC • Live inputs • No effect on aircraft behaviour • No control over scenarios explored • Soak testing • Full safety case not required

  12. ASAS Categories • Airborne Traffic Situation Awareness • Current ATC rules apply • Airborne Spacing • Aircrew given more tasks • Airborne Separation • Temporary delegation of separation to aircrew • Airborne Self-separation • Full delegation of separation

  13. Validation Framework Requirements • Generic • Across validation techniques • Across ASAS categories • Comprising • Scenario - ‘environment’ for validation • Metrics - what will be measured • Guidelines - assistance to validators and managers • To ensure • Consistency of validation • Comparability of validation

  14. Primary Focus • Provide a structured approach • Ensure consistency of PROCESS • Guidelines • Scenario specification process • System performance metric structure • Human performance metric structure • Route map from EMERALD RTD Plan

  15. Work Packages

More Related