1 / 34

Performance Metrics for Weatherization

Performance Metrics for Weatherization. David Carroll State WAP Evaluations ACI Home Performance Conference April 30, 2014. What is Performance Measurement?. 2. Step 1 - Goals. What are your goals? Are you trying to serve a certain population? Are you trying to affect … Energy use?

nash-mcfarland
Download Presentation

Performance Metrics for Weatherization

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Performance Metrics for Weatherization David Carroll State WAP Evaluations ACI Home Performance Conference April 30, 2014

  2. What is Performance Measurement? 2

  3. Step 1 - Goals • What are your goals? • Are you trying to serve a certain population? • Are you trying to affect … • Energy use? • Energy costs? • Payment problems? • Emissions? • Health problems? • How will you know when you are successful? 3

  4. Step 2 – Measurement • Overall Research • Who are you serving? • How are you serving them? • What are they saving? • What other benefits are you delivering? • Comparative Research • What approach maximizes energy, cost, payment, emissions, health impacts? 4

  5. Step 3 - Assessment • Assessment • What are your goals for your program? • Does your performance match your goals? • How can you better align your performance with your goals? 5

  6. Step 4 – Improvement • Strategies • Changing who you serve • Targeting • Partnerships • Changing what you deliver • Assessments • Measures 6

  7. Step 4 - Improvement • Strategies (continued) • Changing your performance • Comparative analysis • Mentoring / partnerships • Changing funding available • Leveraging • Advocacy 7

  8. A Comprehensive Approach to Performance Measurement 8

  9. Benchmark • Use data on …. • Population / Census Data (ACS) • Recipients / LIHEAP or Energy Assistance • WX Clients / Demographics, Housing Units, Baseline Conditions 9

  10. Observe • Observations of …. • Intake • Audits • Service Delivery • Inspections 10

  11. Measure • Collect data on …. • Installed Measures • Post-WX Conditions • Pre/Post Energy Usage • Client Outcomes – Payments, Housing, Health 11

  12. Analyze • Study …. • Gross changes in weather-normalized usage • Net changes using a comparison group • Variations in outcomes by key client, building, and program factors 12

  13. Assessment • Investigate… • Why are some subgroups seeing high impacts? • Why are some subgroups seeing low impacts? • What strategies might be tested to better align outcomes with goals? 13

  14. Who are you Serving? Example of using Census and LIHEAP data as a Benchmark 14

  15. Minnesota Households - 2010 About one in four Minnesota households were income-eligible for the LIHEAP Program in 2010. Source: 2010 American Community Survey 15

  16. Minnesota LIHEAP and WAP Recipients in 2010 About 38% of income-eligible households received LIHEAP and 2% received WAP. National averages are 17% and 0.5%, respectively. Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database 16

  17. Housing Unit Type LIHEAP is less likely to serve households in Large Multi-Family buildings. WAP serves very few households in Multi-Family buildings of any type. Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database 17

  18. Housing Unit Type LIHEAP is less likely to serve households in Large Multi-Family buildings. WAP serves very few households in Multi-Family buildings of any type. Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database 18

  19. Ownership Status LIHEAP serves both owners and renters. WAP is less likely to serve renters. Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database 19

  20. Ownership Status – Single Family Units Even if we control for housing unit type, WAP is more likely to serve owners than renters. Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database 20

  21. Ownership Status of WAP Participants – Single Family Units Control for housing unit type reduces that variation in service to renters by substate area. Source: 2010 American Community Survey and 2010 MN LIHEAP/WAP Database 21

  22. How are you serving them? Example of furnishing details for the state, region, and agency. 22

  23. 23

  24. 24

  25. How much energy are you saving and how does that vary by important program factors? 25

  26. Table 1WAP Energy Impacts for Single Family Site-Built HomesGross and Net Gas Savings by End Use (therms/year)

  27. Table 3WAP Energy Impacts for Single Family Site-Built HomesGas Savings for Homes with Natural Gas Main HeatBy Measure Combination (therms/year)

  28. Table 4WAP Energy Impacts for Single Family Site-Built HomesNet Gas Savings for Natural Gas Main Heat by Pre-Weatherization Gas Usage (therms/year)

  29. Table 12Gas Impact Results by Agency for Gas Heated Single Family Site-Built Homes

  30. Make sure you consider other program impacts. 30

  31. Table 26Emissions BenefitsEstimated Value of Avoided Emissions per Home for Single Family Site-Built Homes (2013 Dollars)

  32. Dwelling Quality Indicators 32

  33. Affordability Indicators 33

  34. Contact David Carroll, 609-252-8010 david-carroll@appriseinc.org APPRISE 32 Nassau Street, Suite 200 Princeton, NJ 08540 34

More Related