NRIC V Council Meeting - October 30, 2001

1. Focus Group 2.B1 Network Reliability - Data Reporting & Analysis NRIC V Council Meeting - October 30, 2001

2. Agenda • Governance • Charter • Membership • Key Deliverables • Reliability Reporting

3. Governance Focus Group 2 Network Reliability Chair: Brian Moir, ICA (202) 331-9852 Focus Group 2.A1 on Best Practices Chair: Rick Harrison Telcordia (732) 758-2013 Focus Group 2.B1 on Data Reporting and Analysis Chair: P.J. Aduskevicz, AT&T (908) 234-5790 Focus Group 2.A2 on Best Practices Packet Switching Chair: Karl Rauscher Lucent Technologies (908) 582-5306 Focus Group 2.B2 on Data Reporting and Analysis for Packet Switching Chair: Paul Hartman Hartman Associates (913) 893-9722

4. Charter I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. • Criteria for determining types of outages to be reported will be developed by each industry segment building on the recommendations from NRIC IV. • The process for reporting data during the voluntary trial will be documented and implemented. • Analysis of the data from the trial will be conducted by a neutral third party. • Industry associations will be requested to encourage participation by their constituents. • At the completion of the trial period, an evaluation of its effectiveness will be conducted and a recommendation made. II. Evaluate outage-reporting requirements and guidelines currently used by wireline carriers to improve the quality of outage reporting. III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC quarterly reports.

5. Membership 2.B1 - Data Reporting and Analysis Team

6. Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status • Recommendation to NRIC IV to proceed with trial predicated on FOIA exemption • NRIC V Chairman sent letter to industry association representatives reinforcing commitment to voluntary trial and explaining MOU (Memorandum of Understanding) signed by NCS/NCC and FCC ensuring that proprietary information provided under the agreement is protected against unauthorized use or disclosure • Industry associations have reviewed the Chairman’s letter and the MOU with their members • Flowchart of reporting process and criteria for data scrubbing by NCS/NCC have been validated and refined • Trialed process • Handed off data to Best Practices Team • Overarching trial goals and data analysis options have been documented by the team and distributed to industry association representatives

7. Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status • Progress has been made through the industry associations and outreach activities in identifying trial participants and obtaining positive reports when no outages have occurred. • Outreach activities have been initiated to increase participation • ATIS Teleconference Series (INFOSYNC) presentation • Contact Campaign • Process work has been completed

8. Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status • NCS/NCC has received five outage reports to date (one additional report was received under the mandatory reporting process, per CFR 63.100, that is more appropriately reported under the voluntary trial) • Limited participation remains an issue, however the amount of participation is increasing • Percent participation by industry segment is shown on the following chart

9. INDUSTRY SEGMENT PARTICIPATION Satellite Telephony No participants CMRS CMRS participants represents approximately 43% of the market by subscribers Paging No participants Cable Telephony All qualified NCTA members participating (representing > 99% of the market by subscribers) ISPs ISP participants represent approximately 20% of the market by traffic volume Data Networking Data Networking participants represent approximately 40% of the market by traffic volume Key Deliverables • Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact.

10. Key Deliverables I. Implement a voluntary one year trial with participation by Internet Service Providers, CMRS, satellite, cable, and data networking service providers to alert National Communications System/National Coordinating Center for Telecommunications (NCS/NCC) of outages that are likely to have significant public impact. Voluntary Trial Status • Final report structure has been established, relevant points have been developed in key sections, and outage report data will be analyzed. • The team is considering the following options for the final recommendation: • Extend the voluntary trial due to the time required to implement the reporting process in participating companies • Termination of the trial on November 15, 2001 and report on trial processes and data analysis • Termination of the trial on November 15, 2001, report on trial processes/data analysis and gather data through other forums. Many entities have been extensively involved in information sharing, reliability issues, and security, post 9/11. It might be more appropriate for these forums to be the focal point for this type of activity.

11. Key Deliverables II. Evaluate outage-reporting requirements and guidelines currently used by wireline carriers to improve the quality of outage reporting. • Revised Network Reliability Steering Committee Charter to Reflect intent to “improve” reliability verses previous charter to “monitor” • Changed baseline for FCC Reportable Service Outages from first year to cumulative going forward • Began conducting special analysis on detected trends (for example, single failure affecting large geographic areas) • Began performing analysis on Emergency Services Outages • FCC working to implement 63.100 electronic filing and putting template into “user friendly” format. • NRSC recommendations to improve outage reporting template are being implemented

12. Key Deliverables III. Evaluate and report on the reliability and availability of the PSTN utilizing NRSC quarterly reports. • Utilize NRSC to report data analysis from 63.100 process • Outage results assembled and analyzed by Network Reliability Steering Committee • Quarterly and annual results for overall outages and sub categories available on web site: http://www.atis.org/atis/nrsc/nrschome.htm • Will incorporate analytics from Voluntary Outage Reporting Trial for cable, satellite, wireless, ISPs to extend Network Reliability Reporting based on the Voluntary Trial Data Analysis Options • Work is progressing on the mechanized reporting process for mandatory outage reporting • Study group to review CCS outages and identify possible causes of the recent increase and initiated an awareness program completed its analysis • 2000 Annual Report complete • Special recognition of September 11th reports

13. Reliability Reporting NRSC – 2Q01 ResultsFCC Reportable Service Outages (by number of events)

14. Reliability Reporting NRSC – 2Q01 ResultsFCC Reportable Service Outages (by outage index)

15. Reliability Reporting NRSC – 2Q01 Results Failure Category - Common Channel Signaling (by number of events)

16. Reliability Reporting NRSC – Annual Control Chart FCC Reportable Service Outages (by number of events)

17. Reliability Reporting NRSC – Annual Control Chart FCC Reportable Service Outages (by outage index)

18. Reliability Reporting NRSC – Annual Control Chart FCC Reportable Service Outages Procedural Error Root Cause Category (by number of events)

19. NRSC Significant ResultsThrough 2Q01 • Outage frequency overall was in the “Green” region. Within failure categories, all outage frequencies were within the “Green” region. • While the aggregated outage index overall was in the “Green” region, it is the third highest ever (618), and the aggregated outage index for Procedural Error (349) is the highest ever and in the “Red” region. • The frequency of Facility outages (51) and Local Switch outages (17) over the last four quarters were the lowest of any four consecutive quarters. • The frequency of CCS outages (40) and CO Power outages (26) over the last four quarters were the greatest of any four consecutive quarters.

20. NRSC Significant ResultsThrough 2Q01 Based upon analysis of all outages reported from 1Q93 through 2Q01, the NRSC notes: • There is an increasing trend in the number of Tandem Switch, CO Power, CCS, and DCS outages. • There is an increasing trend in the frequency and aggregated outage index of Procedural Errors as the root cause of outages. • There is a decreasing trend in the number of Facility and Local Switch outages.

21. NRSC Significant ResultsThrough 2Q01 NRSC alert to the Industry As noted above, CCS outages over the last four consecutive quarters are the highest of any four consecutive quarters since the beginning of the Baseline Period. In this regard, earlier this year, the NRSC formed a study group to review CCS outages and to identify possible causes of the recent increase. The findings of this group indicate that these outages could have been prevented, or their impact mitigated, had previously identified Best Practices been followed. These findings further highlight the need to increase industry awareness of CCS outages and application of Best Practices. These Best Practices may be found at http://www.atis.org/pub/nrsc/fg3sc1final310.PDF.

22. September 11th Outages Reported to the FCC • Nine initial reports • Size of service providers covered wide range • One report appears more appropriately reported under the voluntary trial • Demonstrates willingness of industry to share appropriate information on impacts of this significant event

23. BACK-UP

24. Voluntary Trial Process Subcommittee 2.B 1 Service Provider NCS/NCC NRIC V Outage Occurs Handoff scrubbed data required by 2.A1 and 2.A2 (Best Practices) NCS/NCC Logs Report Initial Final Determine if Outage Meets Vol. Trial Criteria Scrub Data per Criteria Established by 2.B1 Does 2.B2 want to use data? Initial Final Local Root Cause Analysis If no Aggregate And Send Data • Analyze Scrubbed • Data: • By Type/Segment • Impact • Frequency • Root cause for • Commonality If yes Create Initial Report within 3 Days – Mark Company Proprietary Fax to NCS/NCC On (703-607-4998) Provide status at NRIC V Council meetings Monitor Progress Conduct Root Cause Analysis Determine whether request to share data should be made Concur or Provide Input on Recommendations Make Recommendations Identify Best Practices If no Fax Final Report with in 30 Days If yes Take No Further Action Grant Permission to Share Data? If no File Final Report Develop Final Report to Include Recommendations Share Scrubbed Data (i.e. NIPC) If yes • Service Provider – Companies who provide CMRS, Satellite, Cable Telephony, ISP and Data Services • NCS/NCC (National Communication System/National Coordinating Center) - Joint industry-government • organization and mechanism by which the federal government and telecommunications industry respond • to national security and emergency preparedness (NS/EP) telecommunications service requirements. • Subcommittee 2.B1 – A subcommittee of the NRIC V Network comprised of representatives of • industry associations, consultants, and providers for wireline and non-wireline services and equipment. • NRIC V – A federal advisory committee that is chartered to evaluate and report on the reliability of • public telecomm network services in the US including the reliability of packet switched networks.

25. Template NON-WIRELINE VOLUNTARY NETWORK OUTAGE INITIAL REPORTING TEMPLATE

26. Voluntary Trial Outage Report - Scrubbed Data Criteria Agreement with Team – For Data Handoff

27. Potential Analysis Options Scrubbed Final Report field Sample Analysis Action Potential Product or Conclusion Outage Tag Filter data by industry segment in conjunction with other fields Comparison of outage frequencies by industry segment Identification of any industry segment-specific anomalies Start Date Aggregate outages by unit time Outage frequency graphs by week, quarter, time, etc. Date- or time-specific conclusions (e.g.,weekend vs weekday, holidays, rush hour outages) Start Time of Impact Estimated number of customers affected Outage Index graphs (characterizing outage severity) Verification of /Additions to T1A1.2 outage index method New industry segment-specific outage indices Comparison of outage severity trends; recommendations on appropriate thresholds for reporting by industry segment Apply outage index Identify new outage index Types of Services Affected (if applicable) Identify new services affected within industry segments Recommendation on outage index weightings for new services Outage Index graphs (characterizing outage severity) Verification of /Additions to T1A1.2 outage index method New industry segment-specific outage indices Recommendations onappropriate thresholds for reporting by industry segment Apply outage index Identify new outage index Duration of Outage (hours and minutes) Graphs focusing on key causes by industry segment Recommendation of new causes to track/monitor/mitigate (e.g., DNS, cell site, head end, transponder) Identify existing and new causes Aggregate outages by cause Apparent or known cause Root Cause and Trouble Found [OPT] Aggregate outages by network part; Identify “new” parts (e.g.,radio access segment) Industry segment-specific graphs showing susceptible network parts (e.g., access vs transport): Conclusions on industry-wide “reliability” of network access, etc. Specific Part of Network Involved Identify existing/new methods New best practices/Validation of existing practices Recommendations on restoral and prevention methods by industry segment. Recommendations on “crossover” methods (i.e., practices in one segment that may be of use in others) Methods Used to Restore Service [OPT] Steps Taken to Prevent Recurrence Applicable Best Practice [OPTIONAL]

28. Overarching Trial Goals • Enable a general characterization of reported outages’ impact on the public • Address effectiveness of trial • Identify outage reporting similarities or differences across industry segments • Show that industry has the initiative to gather “outage” information without government involvement • Identify what data should/should not be reported • Provide an opinion on the “State of Reliability” of the examined networks • Address next steps (e.g., continue/stop trial) • Identify the Root Cause(s) (i.e., chain(s) of events that led to an outage) for Best Practices review • Allow Best Practices to be identified for entire industry benefit • Allow unregulated voluntary outage reporting to assist national communications security and awareness • Enable carrier and vendor service improvement for all consumers