120 likes | 392 Views
Presentation of Proposed Grouping of 2006 Energy Efficiency programs for Evaluation Planning. Mike Messenger CEC Evaluation Staff July 20, 2005.
E N D
Presentation of Proposed Grouping of 2006 Energy Efficiency programs for Evaluation Planning Mike Messenger CEC Evaluation Staff July 20, 2005
Problem Statement- How to group programs across utility service areas and program strategies to facilitate timely completion of Process, Impact and Market assessment within a 3 year cycle and staffing constraints
Criteria for Grouping/Scheduling • Be able to estimate/validate performance basis for major programs for each area • Fine enough detail to provide useful process insights to improve strategies • Reduce number of evaluation contracts • Allow for evaluation of the effectiveness of marketing and potential measurement of spillover impacts • Stage process, impact and market assessment over three year cycles; don’t want all impact in first year for example
Proposed Grouping Strategies Evaluated • By Program Strategy • By End use and Customer segment • By Market Segment • By Utility Service Area • By Customer Segment • Tentative Winner- Strategy and Major Market Segments
Proposed Grouping by Strategy- Non Residential and Cross cutting
Proposed Evaluation Study Sequence by Strategy Grouping-Residential
Proposed Evaluation Study Sequence by Strategy Grouping-Non Residential
Evaluation Objectives for Market Assessments ( 4 total) • Provide an estimate of the total energy and peak savings achieved in this market over the last 2? Years for each of the four utility areas and a breakdown of the relative share of each of the major strategies operating in the market. ( include spillover?) • Provide an assessment of the extent that these programs have caused changes in market structure and their sustainability
Evaluation Objectives for Impact Assessments • Estimate/Validate ex ante estimates of program strategy savings using protocols • Provide insights about why there may be differences between ex ante and ex post values • Estimate impacts by end use and measure if feasible
Evaluation Objectives for Process Evaluations • Evaluate effectiveness of marketing and program designs • Evaluate if program theory is valid • Provide suggestions for improvement both in program processes and methods to reach and motivate customers