140 likes | 238 Views
Trial SMS Assessment. 4 th ARAST Meeting Bangkok, Thailand 21 to 25 February 2011. Objective. To Report on the Trial SMS Assessment completed by COSCAP in 2010. Background. Effective implementation of SMS is key to achieving the desired safety benefits
E N D
Trial SMS Assessment 4th ARAST Meeting Bangkok, Thailand 21 to 25 February 2011
Objective • To Report on the Trial SMS Assessment completed by COSCAP in 2010 Trial SMS Assessment
Background • Effective implementation of SMS is key to achieving the desired safety benefits • Service Providers will implement SMS to meet State requirements • Civil Aviation Authorities will conduct oversight to verify effective implementation • Traditional oversight audit and inspections methods measure compliance (i.e., implementation and use) • Traditional oversight audit and inspections methods not well-suited to measure effectiveness of SMS processes Trial SMS Assessment
Assessment Method • Based on ICAO Safety Management Manual SMS Gap Analysis • Preparation ~~ Development of method and assessment tools • Conduct of Assessment ~~ Four Parts: • Completion of a Documentation Review Guide by the Air Operator • Review of the completed Review Guide and Company documentation by the Assessment Team • On-site assessment • Report Completion Trial SMS Assessment
ICAO Safety Management Manual (DOC 9859) • Provides guidance on the features of an SMS • SMM includes a “Gap Analysis” table to assist implementation • “Gap Analysis” table identifies features that an SMS should have • COSCAP developed SMS “Expectations” from the Gap Analysis Trial SMS Assessment
Gap Analysis ~~ SMS Assessment Expectations Trial SMS Assessment
Assessment Documentation • Outline of Trial Assessment (pdf) • Expectations (pdf) • Documentation Review Guide (pdf) • Assessment Worksheet (sample) Trial SMS Assessment
Assessment Conduct • Review of Company safety management documents & records • Review of actual processes • Interviews with personnel (President, middle management & staff) • Observation of actual work practices Trial SMS Assessment
Evaluation of Assessment Method • Generally good • Expectations • Some revision of expectations required for clarity • Eliminate some duplicate expectations • Worksheets • Reduce number of sample questions • Clarify sample questions • Improve alignment of questions to their expectation Trial SMS Assessment
Evaluation of Assessment Method • Model report required • Assessment Team training required • Guidance for Assessment timeline required • Formal initiation by CAA • Notification of Service Provider • Service Provider requires time to prepare Review Guide (minimum 30 days) • Completed Review guide and Service provider documentation needed by Assessment Team 30 days prior to on-site review • Assessment Team face-to-face meetings to complete final review preparations Trial SMS Assessment
SMS Assessment ~~ Next Steps • Revise COSCAP SMS Assessment tools • Conduct second Trial Assessment • Refine models • Develop related COSCAP Guidance material • Distribute to COSCAP members • Provide support and training as requested Trial SMS Assessment
Assessment Team Trial SMS Assessment
Appreciation Tremendous support from COSCAP Safety Partners • Airbus • Association of Asia Pacific Airlines (AAPA) • Boeing Commercial Airplanes • International Air Transport Association (IATA) • Korean Air Lines • SR Technics Trial SMS Assessment
Comments ~~ Questions Kim Trethewey Chief Technical Advisor COSCAP North Asia kim.trethewey@coscap-icao.org Trial SMS Assessment