1 / 10

Review of Pilot 1 (2011) Assessment

Commonwealth Corporation Evaluation of PHCAST. Review of Pilot 1 (2011) Assessment. Navjeet Singh, Vice President of Applied Research & Evaluation nsingh@commcorp.org Lawren Bercaw, Research and Evaluation Analyst lbercaw@commcorp.org February 28, 2012. Presentation. Purpose & Overview

roxy
Download Presentation

Review of Pilot 1 (2011) Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Commonwealth Corporation Evaluation of PHCAST Review of Pilot 1 (2011) Assessment Navjeet Singh, Vice President of Applied Research & Evaluationnsingh@commcorp.org Lawren Bercaw, Research and Evaluation Analystlbercaw@commcorp.org February 28, 2012

  2. Presentation Purpose & Overview The Grant Evaluation Design Year 1 Pilot Review

  3. Purpose and Overview To provide an overview of the evaluation required and planned for the grant To review results from evaluation activities for the first year pilot

  4. Purpose of evaluation • Purpose of the evaluation is to ensure that for the “Core” Curriculum and Curriculum Design is consistent between the PCA and PCHM training and lead to better outcomes: • skills and knowledge gain for PCAs, PCHMs; • improved demonstration of skills on the job by PCAs and PCHMs, and • improved outcomes for clients and consumers.

  5. What is this grant about? Integrated and Transferrable PHCAST Training Existing Training PHCAST Grant Personal Care HomeMaker (PCHM) MA Council - Home Care Services curriculum MA Council PHCM curriculum Direct care worker competencies and PHCAST core curriculum developed PCAs-no formal training Personal Care Attendant (PCA) BCC PCA Curriculum BCC/BEC PCA curriculum

  6. What is the evaluation design? • Is the PHCAST curriculum transferrable to different worker types(PCHM or PCA)? Do PCHM and PCA demonstrate positive learning outcomes? • PCAs and PCHMs understand differences in their roles? • PCAs and PCHMs demonstrate positive learning outcomes? • Do employers report greater worker satisfaction and retention? • Concerns about evaluation results –various other factors at play: • PHCAST instructor and delivery of training • Context and environment in which training is delivered • Varying needs of independent consumers and agency based clients

  7. Formative Evaluation • To provide feedback on the process as well as the curriculum: • From students who attended the pilot Year1 • Student reaction survey after they completed the training • From PHCAST instructors using the curriculum • Instructor feedback • Instructor focus group

  8. Student Assessment Results Skills Assessment • Students had to demonstrate selected skills (e.g., hand-washing, lifting, transferring) • Most students (80%) were described as skilled in most areas and were not classified as “needing review” in any skill Written Assessment

  9. Key Issues Identified • Are there questions that those with certain characteristics were more likely to answer incorrectly? Characteristics we checked for: • Home Care Council classes compared to Community College classes • Limited English ability • Education: with less than high School compared to those with HS diploma or more education • Previous experience in health care

  10. Results of Formative Evaluation • Students reported high levels of satisfaction with PHCAST training and strong interest in working as PCAs/PCHMs • Instructors also indicated high satisfaction overall with all materials, especially • More information and material resources • More hands-on and interactive activities • Potential areas for improvement suggested by instructors: • Need more time or less material for most modules • More time for practicing skills • “Infection Control” had too much material, and at higher language level • Need more visual aids, graphics, perhaps videos

More Related