370 likes | 393 Views
THE ROLE OF PROFICIENCY TESTING - A PERSPECTIVE FROM AN ACCREDITATION BODY. Randall Querry American Association for Laboratory Accreditation (A2LA) November 30, 2015 Washington, DC. Presentation Overview. Laboratory Accreditation Proficiency Testing Requirements
E N D
THE ROLE OF PROFICIENCY TESTING - A PERSPECTIVE FROM AN ACCREDITATION BODY Randall Querry American Association for Laboratory Accreditation (A2LA) November 30, 2015 Washington, DC
Presentation Overview • Laboratory Accreditation • Proficiency Testing Requirements • AB’s use and reliance on PT Results • Laboratory’s use of proficiency testing
What is Accreditation? ‘Independent evaluation of conformity assessment bodies against recognized standards to ensure their impartiality and competence to carry out specific activities, such as tests, calibrations, production of reference material, inspections and certifications.’
Who “accredits” the accreditors? • Peer evaluations - 4 year cycle • Evaluation team consists of experts from EA, APLAC, ILAC, IAAC • Observed by US Government agencies • AB operates in accordance with • ISO/IEC 17011 • ILAC Requirements • ABs requirements
The International Picture ILAC ILAC APLAC APLAC EA EA IAAC IAAC SADCA EAEuropeanCooperation for Accreditation APLAC Asia Pacific Laboratory Accreditation Cooperation ILAC International Laboratory Accreditation Cooperation IAAC Inter-American Accreditation Cooperation AFRAC African Regional Accreditation Cooperation ARAC AFRAC SADCA Southern African Development Community Accreditation ARAC Arab Accreditation Cooperation
Accreditation Benefits... • Applicants • Provides a Credential • Regular, objective “check-up” • Increased productivity • International recognition and acceptance • Staying on “cutting edge” • Improved performance
Accreditation Benefits... • Users • Confidence in accuracy of data/materials/products • Accredited organizations listed on AB’s website • Customers gain efficiency by deferring to assessments by accreditation body • Reduced overhead with reliance on accredited third-party organizations
A2LA Goals • Achieve customer satisfaction through meeting the needs of both laboratories and their users for competent testing • Improve the quality of laboratories and the data they produce; and • Increase acceptance of accredited laboratory data to facilitate trade.
How do we achieve these goals? • Assessments leading to Accreditation • Providing training courses • Outreach • Involvement in industry groups • International activities
A2LA Today • Providing accreditation for 38 years • Approximately 180 technical assessors • Over 2,800 organizations accredited • Government, non profit, research and development, internal quality control and commercial testing/calibration laboratories
Accreditation Process • Lab provides completed application • AB staff reviews it for completeness • Assessment team proposed/assigned • On-site visit evaluates management system and technical aspects • Report issued • Corrective action response and AB review
Accreditation process continued • Accreditation Council decision • Acceptable proficiency testing results • Accreditation granted!!! • Accreditation is valid for two years • New applicants receiving accreditation undergo surveillance visit in first year • Renewal applicants-no onsite visit
Accreditation Cycle • Accreditation is valid for two years • New applicants receiving accreditation undergo surveillance assessment after one year • Renewal applicants have no onsite assessment until 2nd year renewal.
Ongoing Monitoring • Annual Reviews • Updates on personnel/organization charts • Internal audit records • Management Review records • Submittal of Proficiency Testing Results
Proficiency Testing • Proficiency testing providers (PTP) • Blind samples for testing or calibration • Lab results reported to PT provider • PT provider evaluates participants results • PT provider reports the results to the participating labs and identifies outliers
Proficiency Testing • Process of checking actual laboratory performance • Indication of laboratories competence • Tool used by ABs to verify a laboratory’s competency to perform specific tests or types of tests
Proficiency Testing Requirements • ISO/IEC 17011:2004 • ILAC P9 • ISO/IEC 17025:2005 • Accreditation Body Program Requirements
ISO/IEC 17011:2004 • General requirements for accrediting bodies accrediting conformity assessment bodies • 7.15.1 states “the AB shall establish procedures to take into account, during the assessment and the decision-making process, the lab’s participation in proficiency testing.”
17011:2004 continued... • 7.15.2 The AB may organize PT or other comparisons itself, or may involve another body judged to be competent. The AB shall maintain a list of appropriate PT programs.
17011:2004 continued... • 7.15.3 The AB shall ensure that its accredited labs participate in PT, where available and appropriate, and that corrective actions are carried out when necessary. The minimum number and frequency of participation shall be specified...
ILAC P9:2010 • Policy document on Participation in national and international PT Activities • Provides guidance on testing and calibration
ISO/IEC 17025:2005 • ISO/IEC 17025 section 5.9 requires quality control procedures and a documented plan • Maintain records of results • Ability to detect trends
ISO/IEC 17025-What is not specified? • frequency of participation • statistical analysis tools to be used • performance criteria
Interested Parties • ISO/IEC 17011:2004 section 7.15.3 states that the minimum amount of PT and the frequency of participation shall be specified in cooperation with interested parties and shall be appropriate in relation to other surveillance activities.
Program Requirements • Accreditation Bodies accommodate users of accredited lab data, specifiers, and regulatory agencies by implementing program requirements that go above and beyond ISO/IEC 17025 Requirements. • AOAC, TNI, EPA-NLLAP, are a few examples that are currently offered.
AOAC PT Requirements • If the PT program itself does not define frequency of testing or if a program is not suitable/feasible, the PT activities should cover a minimum of one activity per method/test/technology per year. The lab’s entire Scope should be covered over a 4 year period.
A2LA PT Requirements Document • Requires documented plan • No subcontracting / treat as “real” samples • Instructions for providing results to A2LA • Instructions on handling unacceptable results • Corrective action responses
Accrediting Bodies’ use of PT • Granting accreditation • Ongoing monitoring • Expansion of existing accredited lab scopes
Lab - PT Provider Relations • A2LA encourages the use of accredited proficiency testing providers • Accredited PT Providers are found to be competent, by meeting ISO/IEC 17043:2010
ISO/IEC 17025 4.6.4 • Laboratory’s need to consider section 4.6.4 when enrolling in PT programs - “The laboratory shall evaluate suppliers of critical consumables, supplies and services which affect the quality of the testing and shall maintain records of these evaluations and list those approved.”
A2LA Guidance for Reviewing PT Reports • A2LA Checklist • Compliance to ISO/IEC 17043 • Use of samples of the same type as routinely used • Use of homogenous and stable samples • Appropriate evaluation criteria
Clear Instructions and PT Reports • Identity of PT scheme • date • type of sample • tested characteristic • method or calibration • lab’s reported value • details about method used • the assigned value • range of acceptable results • evaluation of performance • summary results from other labs
PTP Scheme Operations • Date of shipments, response due and anticipated reports • complete description of samples • source of assigned value • range of satisfactory results • Procedures used to statistically analyze the data • use of competent subcontractors • evidence of functioning management system • satisfactory service
More than just an accreditation hoop…PT provides labs: • An external comparison • An educational/ instructional tool • Tool for continuous improvement
Summary • AB can rely on PT to determine lab is technically competent between on site assessments • Labs can rely and benefit from participating in PT for improvement, scope expansion and demonstrating competence • Users are provided assurance of ongoing competence
Contact Info Randall QuerryA2LA5202 Presidents Court, Suite 220 Frederick, MD 21703 Direct line: 301 644 3221 Fax: 301 662 2974 rquerry@A2LA.org www.A2LA.org