ASW Automated Metrics: VS07 Data Collection Proposal

1. ASW Automated Metrics: VS07 Data Collection Proposal Tom Murphree Naval Postgraduate School (NPS) murphree@nps.edu Bruce Ford Clear Science, Inc. (CSI) bruce@clearscienceinc.com Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com

2. VS07 Automated Metrics Data Collection Opportunity • VS07 presents excellent opportunity to determine/test data collection capability and methods for collection of • NOAT collection node • RBC collection node • MPRA collection node • Exercise collection node (potentially) • In addition to capability and methods, VS07 is an excellent data point to collect METOC impacts • Allows data collection system designers to witness ASW support process from multiple nodes • Allows opportunity to fine-tune aspects of overall ASW metrics collection plan Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com

3. VS07 Autometrics Primary Goals • Record operational impacts of the RBC on it’s primary support customer (deployed NOATs) • Coordinate all metrics collection activities (autometrics and non-autometrics related) • Observe RBC operations and become familiar with RBC support process • Define data collection automation opportunities and methods that may enable continuous collection of RBC operational impact information Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com

4. Overall VS07 Metrics Data Collection Plan • Locations of Metrics Data Collectors • Aboard each participating CV/ASWC NOAT • RBC • Embedded with deployed MPRA TSC (MOCC) • Embedded with each major staff (CTF-74, 3rd Fleet) NOAT Ford B , VS07 Data Collection May 07, bruce@clearscienceinc.com

5. Overall VS07 Metrics Data Collection Plan (continued) • Aboard each CV • Mimic NOAT data collection role by collecting all: • Discrete data • Verifying in situ data • Recommendations (tactical and mitigation) • Recommendation outcomes • Customer measures of success • Investigate other potential data sources, methods, customer measures of success, etc. • RBC • Monitor watch officer actions and log for potential data collection • Monitor NOAT interactions • Observe product preparation for process metrics opportunities • Embedded with deployed MPRA TSC (MOCC) • Mimic MPRA data collection by collecting: • Data from each GREEN and PURPLE • Discrete forecast elements • Investigate other potential data sources, methods, customer measures of success, etc. Specific to measuring RBC operational impact on deployed NOATS Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com

6. Overall VS07 Metrics Data Collection Plan (continued) • Embedded with each major staff • Mimic NOAT data collection role by collecting all: • Recommendations (tactical and mitigation) • Recommendation outcomes • Customer measures of success • Investigate other potential data sources, methods, customer measures of success, etc. Specific to measuring RBC operational impact on deployed NOATS Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com

7. VS07 Autometrics Data Collectors and Tasks • Collectors • Metrics data collectors/process observers will be physically located within the ARBC for the duration of the exercise • Dr. Tom Murphree (NPS) • Bruce W. Ford (CSI) • Primary Tasks • Collect and analyze metrics data received from deployed NOATs • Collect and analyze metrics data collected within the RBC • Conduct and archive daily metrics collector chat with deployed metrics collectors • Fine tune data collection forms and methods for deployed collectors • Act as coordinating authority for all VS07 metrics collection activities • Observe RBC operations for automated operational impacts data collection opportunities Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com

8. VS07 Autometrics Data Collection Deliverables • Archived metrics information in the form of completed data collection forms from: • RBC (one form per day) • Each deployed NOAT (one form per briefing cycle) • Each deployed MOCC (one form per MPRA flight) • Archived metrics collector chat logs • Summary reports: • Report of VS07 metrics including the overall assessment of METOC impact on operations • Revised ASW metrics data collection proposal to include lessons learned from VS07 Murphree, T. and B. Ford , VS07 Data Collection May 07, bruce@clearscienceinc.com