460 likes | 664 Views
Expect the Unexpected: Are We Clearly Prepared?. Board Member Training 2006 Session 1: Continuing Competence Session 2: Impact of Technology. Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. Council on Licensure, Enforcement and Regulation.
E N D
Expect the Unexpected: Are We Clearly Prepared? Board Member Training 2006Session 1: Continuing CompetenceSession 2: Impact of Technology Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. Council on Licensure, Enforcement and Regulation 2006 Annual Conference Alexandria, Virginia
About Us……. Steven K. Bryant, PhD Founder and President, AMP (1982-2002) CEO, Nat’l Board for Respiratory Care (1974-2002) William D. Hogan, ME Vice President, Marketing and Business Products AMP, 1993-Present Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
NBRC and State Regulation • Use of Entry Level Exam by States • State Licensure Liaison Group • National RC Disciplinary Database • Mandatory Continuing Competency Program, 2002 Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
AMP and Technology • Examination Development/Research • Real Estate Program • National Network of AMP Assessment Centers Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Consistent with……. • CLEAR Guidelines, Modules 4 & 6 • NOCA/NCCA Standards Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence “Luck is where preparation meets opportunity.” Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence Complete Situational Exercises Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
CLEAR Definition….. Success on licensure exams = Minimally competent at the time of testing Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence….. What about the future after licensure? What are our responsibilities? Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing competency programs… • Attempt to address future • Various options: Re-examination (same/different) Self-assessment Portfolio review Continuing education Others Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Re-Examination • Not professionally/politically OK • May not be valid for current job • “Makes money” for agencies • Extra development expense Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Self-Assessment • Difficult to supervise • Not secure • Who really did it? • May not be job-related Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Portfolio Reviews • Similar problems to self-assessment • References are all good • May not be job-related Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Education • Readily available • Acceptable • Lesser of other evils • Professional associations love it Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence Continuing education has become the face of continued competence—are they really the same? Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence Probably not!! • Validity evidence lacking • Exams can measure job performance • CE most preferred anyway Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
NOCA/NCCA Standards ….a process that documents or “contributes to” the continued competence of the certified occupation….. Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Respiratory care……. 48 states regulate the profession---all provide for completion of CE to satisfy continuing competency requirements Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
NBRC Mandatory CCP • Re-examination • Pass higher level exam • Complete CE compatible with states Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Difficulties with imposing CCP • Post-voluntary credentialing • Post-licensure Two different worlds! Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence What Board Members really need to know: • CC is difficult to document • Most often method used is CE • CE Programs offered by many • Administrative pitfalls to avoid Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Administrative Pitfalls…… • Approval of CE Programs • Using what exists • Lead time required • Verification of completion Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence The controversy continues!! Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Continuing Competence Review Situational Exercises Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Speaker Contact Information Thank You! Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. 8310 Nieman Rd. Lenexa, KS 66214 913-541-0400 www.goAMP.com sbryant or whogan@goAMP.com Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
CLEAR Board Training --Session Two The Impact of Technology on Board Meetings, Examination Development and Administration Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Impact of Technology “Technology is a wonderful thing----when it works!!” Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Impact of Technology Technology Assisted Meetings • Focused Displays • Agendas/Background Info • Virtual Meetings Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Sample of NBRC Board Book • AGENDA • Board of Trustees • National Board for Respiratory Care, Inc. • Saturday, May 6, 2006 • 9:00 am – 3:00 pm • Merrick I & II • The Colonnade Hotel • Coral Gables, FL • Call to Order/Secretary’s Roll Call • Introduction/Welcome of New Board Members and Guests 3. Approval of Minutes of November 12, 2005 Meeting 4. Officer Reports (optional – except President) a. President b. Vice President c. Secretary d. Treasurer 5. Public Advisor’s Report 6. Executive Committee Report • Examination Committee Reports (A single resolution to accept all Examination Committee Reports is requested after all have been presented.) a Examination Committee Chairmen b. Entry Level CRT Examination Committee c. Therapist Written Examination Committee d. Clinical Simulation Examination Committee e. Pulmonary Function Technology Examination Committee f. Neonatal/Pediatric Respiratory Care Examination Committee Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Use of Technology During Meetings • Laptops for note taking • Power Point and other aids • Internet Connections • Demonstrations • Video Contacts Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Virtual Meetings • Phone and computer may be needed • Individual review of materials • Committee meetings • Board meetings Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Sample item Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Steps in Examination Development Job analysis/test specs Item development/test assembly Minimum passing level Validation/pre-testing Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Job Analysis/Role Delineation Survey-based Committee-based Content set by law Transportability Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Test Specifications More Important Job Duties Tasks/KSAs Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Test Development Items linked to tasks/KSAs Series of structured reviews Cueing Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Setting the MPL Angoff, Nedelsky, Others Panel of Experts State vs. National Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Validation/Pre-testing Content Predictive Pre-test Item Stats Not Mentioned in CLEAR Guidelines Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Costs of Testing Test for 1 vs. 10,000 Administration Using CBT Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations • Job analysis research • Test development/items reviews • Final test reviews • Post-test statistics Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations Computer-based testing simply replaces a test booklet and answer sheet with a computer--- Real Impact of Technology Instant Results/Quick Re-tests Enhanced Security Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Technology and Examinations High-Stakes Testing vs. Web-tests/self assessments Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Some CBT Pitfalls • Need Integrated System • Reliance on ATG’s • False Sense of “Security” • Human Intervention Important • Proctor Training • Examination Storage Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Impact of Technology “Technology is a wonderful thing---- when it works!!” Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Impact of Technology Review Technology-Related Situational Exercises Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia
Speaker Contact Information Thank You! Steven K. Bryant, PhD and William D. Hogan, ME Applied Measurement Professionals, Inc. 8310 Nieman Rd. Lenexa, KS 66214 913-541-0400 www.goAMP.com sbryant or whogan@goAMP.com Presented at the 2006 CLEAR Annual Conference September 14-16 Alexandria, Virginia