1 / 61

Training: Evaluating Effectiveness and Impact on Work Quality

Training: Evaluating Effectiveness and Impact on Work Quality. Findings from the National Weatherization Evaluation Process Field Study Jackie Berger APPRISE. Presentation Overview. Process Field Study design Audit observation findings Measure installation observation findings

isra
Download Presentation

Training: Evaluating Effectiveness and Impact on Work Quality

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Training: Evaluating Effectiveness and Impact on Work Quality Findings from the National Weatherization Evaluation Process Field Study Jackie Berger APPRISE

  2. Presentation Overview • Process Field Study design • Audit observation findings • Measure installation observation findings • Final inspection observation findings • Training needs, challenges, and strategies

  3. Process field study design

  4. Process Field Study Focus • Audit approach and implementation • Energy education delivery • Measure installation/operation of crews • Post-weatherization quality assurance inspection approach and implementation • Client interaction • Interactions among agency staff • Implications for management, procedures, and training

  5. Process Field Study Goals

  6. Synthesis

  7. Field StudyFlow Chart

  8. Agency Selection • Number of states per region based on WAP funding • State selection based on part of region and program size • Agencies selected to represent:

  9. Social Scientist Role • Training • One week observation at agency • Weatherization manager and staff interviews • Observations • Client intake • Audit • Measure installation • Final inspection • Written agency summary report • Monthly update calls • Final debriefing

  10. Weatherization Expert Role • Training • 3-Week Observations at Agency • Audit observation • Measure installation observation • Final inspection observation • Post Observation Data Entry • Monthly Update Calls • Final Debriefing

  11. Rating Design

  12. Process Field StudyObservations

  13. Process field study audit observation findings

  14. Audit Preparation

  15. Audit Introduction Out of 104 observations completed.

  16. Audit Introduction Rating Design

  17. Audit Introduction Rating

  18. Audit Home Walkthrough

  19. Audit Heating Assessment

  20. Audit Water Heater Assessment

  21. Audit Air Leaking andInsulation Diagnostics

  22. Audit Diagnostic Tests

  23. Audit Combustion Safety Tests

  24. Audit Combustion Safety Tests

  25. Audit Exit Interview

  26. Audit Exit Interview Rating Design

  27. Audit Exit Interview Rating

  28. Audit Ratings

  29. Audit Ratings

  30. Communication of Audit Findings • Audit write-ups do not convey educational opportunities • Work order not always clear or specific enough for installer to understand the desired outcome • Tools that improved information transfer • Pre-work walk through with installer • Attaching photos of critical areas to the work order • In process check-ups with the installers • Air sealing is a particular area for improved communication • Need for flexibility to change work order when problems are found during installations

  31. Audit Findings Opportunities • Utilize energy bills • Increase client engagement • Identify client-specific opportunities for reducing energy use • Auditor understanding of pressure boundaries • Auditor understanding of testing purpose and procedures • Conduct worst case draft testing Strengths • Respect and concern for clients • Explanation of WAP program and process • Use of data collection forms • Auditors meet with contractors to explain audit findings and work scope

  32. Process field study Measure Installation Observation findings

  33. Crews and Contractors Observed

  34. Measure Installation Preparation Out of 114 observations.

  35. Measure Installation Introduction

  36. Measure Installation Window and Door Ratings

  37. Measure Installation Air Sealing Ratings

  38. Measure Installation Attic Insulation

  39. Measure Installation Attic Insulation

  40. Measure Installation Attic Access Work

  41. Measure Installation Insulation Ratings

  42. Measure Installation Crawl Space Ratings

  43. Measure Installation Ventilation Ratings

  44. Measure Installation Heating System Ratings

  45. Measure Installation Air Conditioning Ratings

  46. Measure Installation Water Heater Ratings

  47. Measure Installation Summary Ratings

  48. Measure Installation Findings Opportunities • Increased use of blower door when air sealing • Respect for clients’ homes (booties, covering furniture) • Crew member safety • Increased assessment of HVAC contractors • Explain CFLs when installing • Client education Strengths • Crew flexibility and dedication (above and beyond work scope) • Crew problem solving • Some very high quality work • Experienced HVAC contractors

  49. Process field study final inspection Observation findings

  50. Final InspectionOccupant Interaction

More Related