METOC Metrics for ASW Symposium: Tasking Overview

1. METOC Metrics for ASW Symposium:Tasking Overview CAPT Jim Berdeguez Director, Oceanography Operations for Anti-Submarine Warfare (228) 688-4843 james.berdeguez@navy.mil

2. Background Information • This brief describes the tasks assigned at the end of the METOC Metrics for ASW Symposium held at CNMOC on 04-05 January 2007. • For background information on these tasks and the symposium, see the following document: Summary of ASW Directorate Metrics Symposium [.doc] [.pdf] • More information can also be found at the symposium web site: [http://wx.met.nps.navy.mil/metrics/navy/asw_metrics/asw_symposium/]

3. ASW Metrics Overview • ASW metrics effort must fit within context of global ASW CONOPS • Published by Naval Mine and Anti-Submarine Warfare Command (NMAWC) and available at http://fltaswcom.navy.smil.mil/globalasw.htm • Study the nine major focus points of ASW described in this document and identify the impacts that the METOC community has on each. Impacts may be greater for some points than others. • Primary questions for metrics effort to answer: • In what ways does the METOC community impact the ASW fight? • How can we measure those impacts? • How can we use those measures to improve our impacts?

4. Types of ASW Metrics (part 1) • METOC performance metrics – Metrics of the quality of the METOC organization, including its operations, products, and services (e.g., accuracy of METOC forecasts of SLD) • Customer performance metrics – Metrics of customer success (e.g., number of screen penetrations by threat submarines) • Operational impacts metrics – Metrics of the impacts of METOC products on customer operations (correlation of SLD forecast accuracy to screen penetrations) • Proxy operational impacts metrics - Metrics of product performance that are acknowledged by METOC and customer personnel to be closely related to customer performance, so that the proxy operational impact metrics can be assumed to be good indicators of operational impacts (e.g., accuracy of SLD forecasts which is assumed to be closely related to customer success)

5. Types of ASW Metrics (part 2) • Phenomena metrics – Metrics that relate product performance, customer performance, or operational impacts to specific environmental phenomena (e.g., SLD forecast accuracy in the presence of high winds and seas; screen penetration in the presence of high winds and seas; correlation of SLD forecast accuracy and screen penetration in the presence of high winds and seas) • Other examples of METOC metrics: • METOC Quality Metrics – Metrics of the overall quality of a product or service (e.g., TOA grade). These are a type of METOC performance metric. • METOC Capacity/Readiness Metrics – Metrics of organization’s operations (e.g., number of SMEs available, number of trained watchstanders). These are a type of METOC performance metric. • METOC Efficiency/ROI Metrics – Metrics of how well an organization uses its resources (e.g., number of SMEs required to publish TOA). These are a type of METOC performance metric.

6. 3-D METOC Metrics Space Organizational Axis Spatial/Temporal Axis Whole organization Multiple regions, long period METOC Performance Proxy Ops Impacts Operational Impacts Metrics Type Axis Multiple units Small region, short period Individual unit For details on this figure, see speaker notes section of this slide and symposium summary. Metric process to be conducted in this 3-D space and continuously over time. time

7. 3-D METOC Metrics Space:Example Points Organizational Axis Spatial/Temporal Axis ASW community Multiple ops areas, several years CNMOC SLD forecast accuracy to screen penetration correlation SLD forecast accuracy T forecast accuracy Metrics Type Axis Exercise region, several weeks RBC Single point, one day NOAT/NOAD For details on this figure, see speaker notes section of this slide and symposium summary. Metric process to be conducted in this 3-D space and continuously over time. time

8. 3-D METOC Metrics Space:Initial Focus Region Organizational Axis Spatial/Temporal Axis Whole organization Multiple regions, long period METOC Performance Proxy Ops Impacts Operational Impacts Metrics Type Axis Multiple units Initial focus region (~next 1-3 years) Small region, short period Individual unit For details on this figure, see speaker notes section of this slide and symposium summary. Metric process to be conducted in this 3-D space and continuously over time. time

9. 3-D METOC Metrics Space:End State Focus Region Organizational Axis Spatial/Temporal Axis Whole organization End state focus region (3+ years ahead) Multiple regions, long period METOC Performance Proxy Ops Impacts Operational Impacts Metrics Type Axis Multiple units Small region, short period Individual unit For details on this figure, see speaker notes section of this slide and symposium summary. Metric process to be conducted in this 3-D space and continuously over time. time

10. Focus Committees • The three most likely areas within the METOC ASW directorate for metrics data collection and analysis are: • Support to Maritime Patrol and Reconnaissance Aircraft (MPRA) • ASW Reachback Cell (ARBC) • Naval Oceanography ASW Teams (NOATs) • Three investigative focus committees were formed to answer specific questions and concerns regarding each of these areas. • An executive committee was formed to guide the overall ASW metrics program. • An additional meeting will be held to discuss the focus team findings and plan the next steps of the project. • Each committee is directed to a complete focus committee tasking order by 21 Feb 07. • Forward results to LT Parker @ scott.w.paker@navy.mil

11. MPRA Committee • LEAD: Clear Science – Mr. Bruce Ford • NOAD Kadena OIC - LCDR (Sel) Danny Garcia • NOAD JAX OIC – LT Eric Macdonald • CPRG - CDR Sopko • NRL - Pat Hogan • APL- UW – Mr. Bob Miyamoto • FNMOC – LTJG Dave Watson • PDD South - Doug Lipscombe • SPA - Paul Vodola, Matt McNamara, Luke Piepkorn

12. RBC and NOAT Committees • RBC • LEAD – NOAC RBC LT Heather Hornick • NRL - Jay Shriver, Jim Dykes, Josie Fabre • NAVO – John Blaha, Frank Bub, Keith Atkinson, Dennis Krynen • FNMOC – LTJG Dave Watson • Clear Science – Bruce Ford • SPA - Paul Vodola, Matt McNamara, Luke Piepkorn • NOAT • LEAD – NOAC SSC LT Tim Campo • NOAC Yoko - LCDR Joel Feldmeier • Clear Science - Bruce Ford • NRL - Jim Dykes, Josie Fabre • SPA - Paul Vodola, Matt McNamara, Luke Piepkorn

13. Executive Committee • LEAD: Dr. Tom Murphree (NPS) • CNMOC Technical Director - Mr. Ed Gough • ASW DOO/DDOO - Capt Jim Berdeguez, LT Scott Parker • CNMOC N9 – Steve Lingsch • NMAWC - CDR Ash Evans • N84 – CDR Mike Angove • NRL - Pat Hogan, Josie Fabre, Greg Jacobs • ONR – CDR Doug Marble • SPA – Paul Vodola, Matt McNamara, Luke Piepkorn • PDC – Merrill Stevens • PMW 180 – Marcus Speckhahn

14. Committee Tasking OrderPart 1 Each focus committees will make every attempt to accomplish the following tasks: 1. Determine the customers for the METOC products in your ASW directorate area (MPRA, ARBC, NOATs). Customers may include other METOC personnel, warfighters, and/or others). 2. Describe the METOC support process for these customers in terms of the customer’s mission timeline (e.g., planning, execution, debrief). Diagram and/or flowchart this process. Include: • Unclassified examples of products issued • Annotations of how METOC support is incorporated • Are TTPs used for METOC support? If so, how? 3. Develop an initial list of the metrics that should be developed for the METOC support process. See list of metrics at beginning of section 4, above. List should include at least: • METOC performance metrics • Customer performance metrics • Operational impacts metrics • Proxy operational impacts metrics • Must be closely correlated with customer performance • End user must agree that these proxy metrics are directly related to their ability to complete their mission successfully • Examples: Accuracy of SLD, Sea Surface Height, MDR; buoy depth setting recommendations

15. Committee Tasking OrderPart 2 4. Describe data collection process, including: • Data sources (observations, METOC products, mission debriefs) • Data collection frequency (hourly, 12-hourly, weekly) • Relationship of data collection to end-user mission timeline 5. Describe data analysis process, including process for verifying products, calculating desired metrics, developing reconstructions, etc. 6. Describe operational analyses and/or modeling needed, including data and methods to be used, validation of methods, types of results to be generated, verification of results, etc. 7. Map recommended metrics to 3-D metrics space (Slide 6) 8. Relate your METOC metrics process to other relevant METOC and customer metrics efforts, including past, on-going, or near-future data sets and metrics calculations. 9. Refer to symposium briefs and contact symposium participants for background information, examples of the results you need to prepare for the executive committee, coordination, collaboration, etc.

16. Action: POA&M Draft • Focus committee tasking released – 17 Jan 07 • Focus team committee completion, with Findings due to LT Parker – COB, 21 Feb 07. • ASW metrics meeting and funding proposal – 07-09 Mar 07 • Strategic plan development – ongoing • List of related projects - TBD • List of potential resources (thesis students, ONR?) - TBD • Draft plan for Valiant Shield metrics effort – TBD • NMAWC R&A visit – 22-26 Jan 07 • Provide input for METOC data collection for DCM - TBD • SWDG R&A Visit - TBD • DEVRON 12 R&A Visit - TBD • CPRG Visit - TBD • ARL-UT Visit - TBD • IUSS Visit - TBD • ONI Visit - TBD • List SPA, CNA, John Hopkins, and related projects that have already been completed that we could learn from - TBD • Investigate ASW cross functional team findings for potential metrics information – TDB

17. ASW Directorate“Taking Care of Business” Questions? CAPT Jim Berdeguez Director, Oceanography Operations for Anti-Submarine Warfare (228) 688-4843 james.berdeguez@navy.mil